[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:42:35 dist-test-slave-42z9 krb5kdc[11460](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:42:35 dist-test-slave-42z9 krb5kdc[11460](info): set up 2 sockets
Aug 07 10:42:35 dist-test-slave-42z9 krb5kdc[11460](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 10:42:36.327848 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.005s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:42:36 dist-test-slave-42z9 krb5kdc[11460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:42:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:42:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:42:36.561815 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35383
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:33997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:35383
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:36.936826 11479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:36.937209 11479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:36.937351 11479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:36.945132 11479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:42:36.945293 11479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:36.945386 11479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:36.945497 11479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:42:36.945570 11479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:42:36.956418 11479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:33997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:35383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:36.958124 11479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:36.959787 11479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:36.973480 11489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:36.973486 11488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:36.974050 11492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:36.974406 11479 server_base.cc:1034] running on GCE node
I20260807 10:42:36.975349 11479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:36.977176 11479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:36.978446 11479 hybrid_clock.cc:648] HybridClock initialized: now 1786099356978367 us; error 55 us; skew 500 ppm
I20260807 10:42:36.978889 11479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:36 dist-test-slave-42z9 krb5kdc[11460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099356, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:36.982496 11479 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:42:36.984236 11479 webserver.cc:460] Webserver started at http://127.11.46.190:43501/ using document root <none> and password file <none>
I20260807 10:42:36.985080 11479 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:36.985215 11479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:36.985613 11479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:36.990509 11479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "76ccfeb697924952aba126093fc0c86b"
format_stamp: "Formatted at 2026-08-07 10:42:36 on dist-test-slave-42z9"
server_key: "57f85173ffafcdbcf7d5fac28f10f430"
server_key_iv: "4f648396f14a3f2ee4e7a43ca08e3e56"
server_key_version: "encryptionkey@0"
I20260807 10:42:36.991420 11479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "76ccfeb697924952aba126093fc0c86b"
format_stamp: "Formatted at 2026-08-07 10:42:36 on dist-test-slave-42z9"
server_key: "57f85173ffafcdbcf7d5fac28f10f430"
server_key_iv: "4f648396f14a3f2ee4e7a43ca08e3e56"
server_key_version: "encryptionkey@0"
I20260807 10:42:36.997606 11479 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 10:42:37.001708 11501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:37.003274 11479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:42:37.003497 11479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "76ccfeb697924952aba126093fc0c86b"
format_stamp: "Formatted at 2026-08-07 10:42:36 on dist-test-slave-42z9"
server_key: "57f85173ffafcdbcf7d5fac28f10f430"
server_key_iv: "4f648396f14a3f2ee4e7a43ca08e3e56"
server_key_version: "encryptionkey@0"
I20260807 10:42:37.003733 11479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:37.021077 11479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:37.026051 11479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:37.026389 11479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:37.047017 11479 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:35383
I20260807 10:42:37.047066 11575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:35383 every 8 connection(s)
I20260807 10:42:37.048655 11479 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:42:37.053181 11576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:37.056695 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 11479
I20260807 10:42:37.057080 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:42:37.059888 11450 external_mini_cluster.cc:1428] Setting key 7dd27b59d585e796ddffd0e8a53ade1a
I20260807 10:42:37.068455 11576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b: Bootstrap starting.
I20260807 10:42:37.072160 11576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:37.073421 11576 log.cc:824] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:37.077306 11576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b: No bootstrap required, opened a new log
I20260807 10:42:37.087958 11576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76ccfeb697924952aba126093fc0c86b" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35383 } }
I20260807 10:42:37.088595 11576 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:37.088742 11576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76ccfeb697924952aba126093fc0c86b, State: Initialized, Role: FOLLOWER
I20260807 10:42:37.089687 11576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76ccfeb697924952aba126093fc0c86b" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35383 } }
I20260807 10:42:37.090049 11576 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:42:37.090210 11576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:42:37.090389 11576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:37.093020 11576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76ccfeb697924952aba126093fc0c86b" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35383 } }
I20260807 10:42:37.093695 11576 leader_election.cc:302] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76ccfeb697924952aba126093fc0c86b; no voters:
I20260807 10:42:37.094400 11576 leader_election.cc:288] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:42:37.094602 11582 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [term 1 FOLLOWER]: Leader election won for term 1
Aug 07 10:42:37 dist-test-slave-42z9 krb5kdc[11460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:37.095726 11582 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [term 1 LEADER]: Becoming Leader. State: Replica: 76ccfeb697924952aba126093fc0c86b, State: Running, Role: LEADER
I20260807 10:42:37.096338 11582 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76ccfeb697924952aba126093fc0c86b" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35383 } }
I20260807 10:42:37.097138 11576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:42:37.099738 11584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76ccfeb697924952aba126093fc0c86b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76ccfeb697924952aba126093fc0c86b" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35383 } } }
I20260807 10:42:37.100276 11584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:37.100394 11585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76ccfeb697924952aba126093fc0c86b. Latest consensus state: current_term: 1 leader_uuid: "76ccfeb697924952aba126093fc0c86b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76ccfeb697924952aba126093fc0c86b" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35383 } } }
I20260807 10:42:37.100684 11585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:37.106614 11594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:42:37.111830 11579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:37.065521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59318 (local address 127.11.46.190:35383)
0807 10:42:37.066665 (+ 1144us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:37.066685 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:37.068272 (+ 1587us) server_negotiation.cc:407] Connection header received
0807 10:42:37.078674 (+ 10402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:37.078714 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:37.079313 (+ 599us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:37.079874 (+ 561us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:37.083164 (+ 3290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:37.085366 (+ 2202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:37.088187 (+ 2821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:37.089374 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:37.089656 (+ 282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:37.098054 (+ 8398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:37.098068 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:37.098094 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:37.098162 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:37.104003 (+ 5841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:37.105600 (+ 1597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:37.105615 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:37.105626 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:37.105955 (+ 329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:37.106803 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:37.106811 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:37.106815 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:37.107814 (+ 999us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:37.108193 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:37.109608 (+ 1415us) server_negotiation.cc:299] Negotiation successful
0807 10:42:37.110153 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":817,"thread_start_us":497,"threads_started":1}
I20260807 10:42:37.119645 11594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:42:37.129017 11594 catalog_manager.cc:1347] Generated new cluster ID: bc8e3372b0dd4452ac0727520d3065a3
I20260807 10:42:37.129163 11594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:42:37.142063 11594 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:42:37.144268 11594 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:42:37.154254 11594 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76ccfeb697924952aba126093fc0c86b: Generated new TSK 0
I20260807 10:42:37.155635 11594 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:42:37.212990 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35383
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:33997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:37.656009 11615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:37.656332 11615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:37.656473 11615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:37.664474 11615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:37.664623 11615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:37.664798 11615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:42:37.675894 11615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:33997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35383
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:37.677582 11615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:37.679229 11615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:37.696667 11631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:37.696774 11630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:37.697479 11634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:37.698073 11615 server_base.cc:1034] running on GCE node
I20260807 10:42:37.698918 11615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:37.700078 11615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:37.701300 11615 hybrid_clock.cc:648] HybridClock initialized: now 1786099357701229 us; error 66 us; skew 500 ppm
I20260807 10:42:37.701713 11615 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:37 dist-test-slave-42z9 krb5kdc[11460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099357, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:37.705117 11615 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:42:37.707062 11615 webserver.cc:460] Webserver started at http://127.11.46.129:39603/ using document root <none> and password file <none>
I20260807 10:42:37.707929 11615 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:37.708057 11615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:37.708438 11615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:37.711834 11615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "469631981b864d3da0810bf52a6b53ee"
format_stamp: "Formatted at 2026-08-07 10:42:37 on dist-test-slave-42z9"
server_key: "a6ae9d3c978915bf6c1d8324b6d23458"
server_key_iv: "5418204a35d86652ee07ae2dc6e4e51d"
server_key_version: "encryptionkey@0"
I20260807 10:42:37.712724 11615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "469631981b864d3da0810bf52a6b53ee"
format_stamp: "Formatted at 2026-08-07 10:42:37 on dist-test-slave-42z9"
server_key: "a6ae9d3c978915bf6c1d8324b6d23458"
server_key_iv: "5418204a35d86652ee07ae2dc6e4e51d"
server_key_version: "encryptionkey@0"
I20260807 10:42:37.718832 11615 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260807 10:42:37.722892 11647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:37.724457 11615 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260807 10:42:37.724645 11615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "469631981b864d3da0810bf52a6b53ee"
format_stamp: "Formatted at 2026-08-07 10:42:37 on dist-test-slave-42z9"
server_key: "a6ae9d3c978915bf6c1d8324b6d23458"
server_key_iv: "5418204a35d86652ee07ae2dc6e4e51d"
server_key_version: "encryptionkey@0"
I20260807 10:42:37.724857 11615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:37.756204 11615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:37.761265 11615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:37.761626 11615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:37.762777 11615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:42:37.764308 11615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:37.764416 11615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:37.764552 11615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:37.764618 11615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:37.799623 11615 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:34407
I20260807 10:42:37.799690 11815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:34407 every 8 connection(s)
I20260807 10:42:37.801132 11615 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:42:37.810349 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 11615
I20260807 10:42:37.810613 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:42:37.811385 11450 external_mini_cluster.cc:1428] Setting key 8c84b716bda33f954637a90e9cf81e72
Aug 07 10:42:37 dist-test-slave-42z9 krb5kdc[11460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099357, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:37.824637 11819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:37.804064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:37381 (local address 127.11.46.190:35383)
0807 10:42:37.804620 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:37.804627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:37.805837 (+ 1210us) server_negotiation.cc:407] Connection header received
0807 10:42:37.808050 (+ 2213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:37.808055 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:37.808139 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:37.808232 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:37.810136 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:37.811263 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:37.813350 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:37.813956 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:37.814103 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:37.818041 (+ 3938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:37.818049 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:37.818054 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:37.818102 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:37.821090 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:37.822060 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:37.822067 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:37.822070 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:37.822245 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:37.822686 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:37.822691 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:37.822694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:37.823107 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:37.823264 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:37.824180 (+ 916us) server_negotiation.cc:299] Negotiation successful
0807 10:42:37.824375 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":253,"threads_started":1}
I20260807 10:42:37.826265 11820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:37.804746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35383 (local address 127.11.46.129:37381)
0807 10:42:37.805615 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:37.805686 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:37.807704 (+ 2018us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:37.808486 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:37.808499 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:37.809200 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:37.809927 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:37.809949 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:37.811450 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:37.811455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:37.813157 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:37.813174 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:37.814215 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:37.814221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:37.814453 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:37.815172 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:37.815200 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:37.817724 (+ 2524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:37.821290 (+ 3566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:37.821299 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:37.821316 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:37.821882 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:37.822353 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:37.822356 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:37.822359 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:37.822568 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:37.823230 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:37.823237 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:37.823756 (+ 519us) client_negotiation.cc:769] Sending connection context
0807 10:42:37.824073 (+ 317us) client_negotiation.cc:240] Negotiation successful
0807 10:42:37.824704 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":304,"threads_started":1}
I20260807 10:42:37.828096 11817 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35383
I20260807 10:42:37.828478 11817 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:37.829674 11817 heartbeater.cc:511] Master 127.11.46.190:35383 requested a full tablet report, sending...
I20260807 10:42:37.833336 11528 ts_manager.cc:194] Registered new tserver with Master: 469631981b864d3da0810bf52a6b53ee (127.11.46.129:34407)
I20260807 10:42:37.835039 11528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:37381
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:42:37.863022 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35383
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:33997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:38.245683 11823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:38.246014 11823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:38.246124 11823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:38.253742 11823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:38.253883 11823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:38.254024 11823 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:42:38.264704 11823 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:33997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35383
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:38.266343 11823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:38.267843 11823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:38.283594 11830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:38.283572 11829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:38.284147 11832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:38.284566 11823 server_base.cc:1034] running on GCE node
I20260807 10:42:38.285264 11823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:38.286455 11823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:38.287698 11823 hybrid_clock.cc:648] HybridClock initialized: now 1786099358287632 us; error 49 us; skew 500 ppm
I20260807 10:42:38.288065 11823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:38 dist-test-slave-42z9 krb5kdc[11460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099358, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:38.291668 11823 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:42:38.293329 11823 webserver.cc:460] Webserver started at http://127.11.46.130:42817/ using document root <none> and password file <none>
I20260807 10:42:38.294142 11823 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:38.294269 11823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:38.294636 11823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:38.298063 11823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "ce004a5953f84a0f80cad1e3464e420b"
format_stamp: "Formatted at 2026-08-07 10:42:38 on dist-test-slave-42z9"
server_key: "8115f49183c0d2258a157b8a3963391f"
server_key_iv: "6731b705ca9a822abb32f99fd6866be6"
server_key_version: "encryptionkey@0"
I20260807 10:42:38.298960 11823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "ce004a5953f84a0f80cad1e3464e420b"
format_stamp: "Formatted at 2026-08-07 10:42:38 on dist-test-slave-42z9"
server_key: "8115f49183c0d2258a157b8a3963391f"
server_key_iv: "6731b705ca9a822abb32f99fd6866be6"
server_key_version: "encryptionkey@0"
I20260807 10:42:38.305001 11823 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:42:38.309224 11839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:38.310710 11823 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:42:38.310895 11823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "ce004a5953f84a0f80cad1e3464e420b"
format_stamp: "Formatted at 2026-08-07 10:42:38 on dist-test-slave-42z9"
server_key: "8115f49183c0d2258a157b8a3963391f"
server_key_iv: "6731b705ca9a822abb32f99fd6866be6"
server_key_version: "encryptionkey@0"
I20260807 10:42:38.311118 11823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:38.327338 11823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:38.336454 11823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:38.336807 11823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:38.338266 11823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:42:38.340071 11823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:38.340174 11823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:38.340333 11823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:38.340399 11823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:38.375532 11823 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:44807
I20260807 10:42:38.375572 12008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:44807 every 8 connection(s)
I20260807 10:42:38.377077 11823 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:42:38.377908 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 11823
I20260807 10:42:38.378146 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:42:38.378602 11450 external_mini_cluster.cc:1428] Setting key ab3fdebba9eaf80fa03f51a013491335
Aug 07 10:42:38 dist-test-slave-42z9 krb5kdc[11460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099358, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:38.403849 12012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:38.380185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:49885 (local address 127.11.46.190:35383)
0807 10:42:38.380647 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:38.380651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:38.382262 (+ 1611us) server_negotiation.cc:407] Connection header received
0807 10:42:38.384942 (+ 2680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:38.384947 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:38.385028 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:38.385127 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:38.387597 (+ 2470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:38.388382 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:38.390837 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:38.391540 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:38.391712 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:38.395856 (+ 4144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:38.395863 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:38.395868 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:38.395927 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:38.399773 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:38.400861 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:38.400869 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:38.400873 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:38.401101 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:38.401669 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:38.401675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:38.401678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:38.402116 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:38.402302 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:38.403165 (+ 863us) server_negotiation.cc:299] Negotiation successful
0807 10:42:38.403449 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":250,"threads_started":1}
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
I20260807 10:42:38.404762 12013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:38.381022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35383 (local address 127.11.46.130:49885)
0807 10:42:38.382059 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:38.382116 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:38.384542 (+ 2426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:38.385500 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:38.385514 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:38.386368 (+ 854us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:38.387324 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:38.387355 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:38.388602 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:38.388608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:38.390601 (+ 1993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:38.390622 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:38.391824 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:38.391829 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:38.392077 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:38.392840 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:38.392867 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:38.395475 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:38.400033 (+ 4558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:38.400048 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:38.400072 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:38.400662 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:38.401235 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:38.401238 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:38.401241 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:38.401527 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:38.402252 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:38.402259 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:38.402697 (+ 438us) client_negotiation.cc:769] Sending connection context
0807 10:42:38.402966 (+ 269us) client_negotiation.cc:240] Negotiation successful
0807 10:42:38.403464 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":383,"threads_started":1}
I20260807 10:42:38.406525 12010 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35383
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
I20260807 10:42:38.406886 12010 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:38.407935 12010 heartbeater.cc:511] Master 127.11.46.190:35383 requested a full tablet report, sending...
I20260807 10:42:38.409909 11528 ts_manager.cc:194] Registered new tserver with Master: ce004a5953f84a0f80cad1e3464e420b (127.11.46.130:44807)
I20260807 10:42:38.410789 11528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:49885
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:42:38.436970 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35383
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:33997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:38.831730 12017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:38.832075 12017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:38.832217 12017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 10:42:38.838840 11817 heartbeater.cc:503] Master 127.11.46.190:35383 was elected leader, sending a full tablet report...
W20260807 10:42:38.841674 12017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:38.841820 12017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:38.841948 12017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:42:38.853091 12017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:33997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35383
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:38.854739 12017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:38.856266 12017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:38.871757 12025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:38.871775 12024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:38.872126 12027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:38.872684 12017 server_base.cc:1034] running on GCE node
I20260807 10:42:38.873397 12017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:38.874641 12017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:38.875905 12017 hybrid_clock.cc:648] HybridClock initialized: now 1786099358875808 us; error 70 us; skew 500 ppm
I20260807 10:42:38.876294 12017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:38 dist-test-slave-42z9 krb5kdc[11460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099358, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:38.880272 12017 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:42:38.882215 12017 webserver.cc:460] Webserver started at http://127.11.46.131:44865/ using document root <none> and password file <none>
I20260807 10:42:38.883105 12017 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:38.883250 12017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:38.883661 12017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:38.887281 12017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "255f0ec45e764bfa80280ec5c068bf4a"
format_stamp: "Formatted at 2026-08-07 10:42:38 on dist-test-slave-42z9"
server_key: "3c9a6722c3bebfa5ba3b71e1bd1cd0aa"
server_key_iv: "3c420fc0d2e3398f1eb957d5bdc507fa"
server_key_version: "encryptionkey@0"
I20260807 10:42:38.888221 12017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "255f0ec45e764bfa80280ec5c068bf4a"
format_stamp: "Formatted at 2026-08-07 10:42:38 on dist-test-slave-42z9"
server_key: "3c9a6722c3bebfa5ba3b71e1bd1cd0aa"
server_key_iv: "3c420fc0d2e3398f1eb957d5bdc507fa"
server_key_version: "encryptionkey@0"
I20260807 10:42:38.894968 12017 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 10:42:38.899705 12040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:38.901610 12017 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 10:42:38.901840 12017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "255f0ec45e764bfa80280ec5c068bf4a"
format_stamp: "Formatted at 2026-08-07 10:42:38 on dist-test-slave-42z9"
server_key: "3c9a6722c3bebfa5ba3b71e1bd1cd0aa"
server_key_iv: "3c420fc0d2e3398f1eb957d5bdc507fa"
server_key_version: "encryptionkey@0"
I20260807 10:42:38.902097 12017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:38.921849 12017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:38.926957 12017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:38.927297 12017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:38.928543 12017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:42:38.930339 12017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:38.930455 12017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:38.930605 12017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:38.930665 12017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:38.964920 12017 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:45531
I20260807 10:42:38.964977 12211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:45531 every 8 connection(s)
I20260807 10:42:38.966446 12017 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:42:38.971948 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12017
I20260807 10:42:38.972182 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:42:38.972759 11450 external_mini_cluster.cc:1428] Setting key 16b04d08e994958f90115bcb9736fa80
Aug 07 10:42:38 dist-test-slave-42z9 krb5kdc[11460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099358, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:38.991451 12214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:38.969272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:39481 (local address 127.11.46.190:35383)
0807 10:42:38.969797 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:38.969801 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:38.970969 (+ 1168us) server_negotiation.cc:407] Connection header received
0807 10:42:38.973707 (+ 2738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:38.973712 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:38.973814 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:38.973946 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:38.976341 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:38.977561 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:38.979352 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:38.979759 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:38.979859 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:38.983918 (+ 4059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:38.983924 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:38.983928 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:38.983970 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:38.986607 (+ 2637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:38.988303 (+ 1696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:38.988309 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:38.988311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:38.988498 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:38.989178 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:38.989183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:38.989185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:38.989561 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:38.989720 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:38.990734 (+ 1014us) server_negotiation.cc:299] Negotiation successful
0807 10:42:38.991040 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":288,"threads_started":1}
I20260807 10:42:38.992630 12216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:38.969951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35383 (local address 127.11.46.131:39481)
0807 10:42:38.970777 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:38.970821 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:38.973286 (+ 2465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:38.974286 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:38.974299 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:38.975140 (+ 841us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:38.976130 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:38.976158 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:38.977770 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:38.977777 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:38.979201 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:38.979219 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:38.979966 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:38.979971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:38.980268 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:38.981034 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:38.981063 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:38.983630 (+ 2567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:38.986968 (+ 3338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:38.986984 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:38.987013 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:38.988096 (+ 1083us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:38.988646 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:38.988652 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:38.988655 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:38.989053 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:38.989707 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:38.989716 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:38.990284 (+ 568us) client_negotiation.cc:769] Sending connection context
0807 10:42:38.990602 (+ 318us) client_negotiation.cc:240] Negotiation successful
0807 10:42:38.991295 (+ 693us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":304,"threads_started":1}
I20260807 10:42:38.994267 12212 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35383
I20260807 10:42:38.994637 12212 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:38.995491 12212 heartbeater.cc:511] Master 127.11.46.190:35383 requested a full tablet report, sending...
I20260807 10:42:38.997345 11528 ts_manager.cc:194] Registered new tserver with Master: 255f0ec45e764bfa80280ec5c068bf4a (127.11.46.131:45531)
I20260807 10:42:38.998270 11528 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:39481
I20260807 10:42:39.003109 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:42:39 dist-test-slave-42z9 krb5kdc[11460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099359, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 10:42:39 dist-test-slave-42z9 krb5kdc[11460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099359, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:42:39.063038 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:39.045383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34386 (local address 127.11.46.129:34407)
0807 10:42:39.046190 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:39.046201 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:39.046239 (+ 38us) server_negotiation.cc:407] Connection header received
0807 10:42:39.046324 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:39.046332 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:39.046608 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:39.046777 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:39.048412 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:39.049513 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:39.050877 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:39.051517 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:39.051646 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:39.056142 (+ 4496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:39.056165 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:39.056186 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:39.056241 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:39.059564 (+ 3323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:39.060443 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:39.060453 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:39.060455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:39.060625 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:39.061105 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:39.061109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:39.061111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:39.061606 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:39.061946 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:39.062308 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 10:42:39.062640 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":357,"threads_started":1}
W20260807 10:42:39.064697 11692 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34386
Aug 07 10:42:39 dist-test-slave-42z9 krb5kdc[11460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099359, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 10:42:39 dist-test-slave-42z9 krb5kdc[11460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099359, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:42:39.124534 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:39.108996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34396 (local address 127.11.46.129:34407)
0807 10:42:39.109224 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:39.109231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:39.109649 (+ 418us) server_negotiation.cc:407] Connection header received
0807 10:42:39.109846 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:39.109852 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:39.109966 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:39.110062 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:39.111584 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:39.112314 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:39.113740 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:39.114201 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:39.114334 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:39.118828 (+ 4494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:39.118835 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:39.118839 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:39.118892 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:39.121533 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:39.122370 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:39.122375 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:39.122378 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:39.122548 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:39.122982 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:39.122987 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:39.122989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:39.123283 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:39.123549 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:39.123912 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 10:42:39.124186 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:42:39.126287 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11615
I20260807 10:42:39.140434 12224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:39.127400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34402 (local address 127.11.46.129:34407)
0807 10:42:39.127602 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:39.127606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:39.127868 (+ 262us) server_negotiation.cc:407] Connection header received
0807 10:42:39.128047 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:39.128051 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:39.128116 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:39.128203 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:39.129530 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:39.130378 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:39.131675 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:39.132135 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:39.132237 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:39.134658 (+ 2421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:39.134665 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:39.134668 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:39.134710 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:39.137519 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:39.138312 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:39.138316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:39.138319 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:39.138475 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:39.138960 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:39.138965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:39.138968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:39.139299 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:39.139568 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:39.139864 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 10:42:39.140069 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 10:42:39.141311 11811 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:39.232607 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 11615
I20260807 10:42:39.260331 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11823
Aug 07 10:42:39 dist-test-slave-42z9 krb5kdc[11460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099359, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:42:39.276714 12234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:39.261258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58426 (local address 127.11.46.130:44807)
0807 10:42:39.261867 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:39.261875 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:39.261904 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:42:39.261975 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:39.261981 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:39.262210 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:39.262344 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:39.263593 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:39.264629 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:39.265978 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:39.266653 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:39.266769 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:39.270855 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:39.270871 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:39.270890 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:39.270931 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:39.273832 (+ 2901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:39.274629 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:39.274637 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:39.274640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:39.274786 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:39.275211 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:39.275214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:39.275216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:39.275607 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:39.275864 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:39.276139 (+ 275us) server_negotiation.cc:299] Negotiation successful
0807 10:42:39.276379 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":324,"threads_started":1}
I20260807 10:42:39.278184 12004 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:39.364722 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 11823
I20260807 10:42:39.395066 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12017
Aug 07 10:42:39 dist-test-slave-42z9 krb5kdc[11460](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099359, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:42:39.413410 12238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:39.396134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43128 (local address 127.11.46.131:45531)
0807 10:42:39.396832 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:39.396840 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:39.396873 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:42:39.396956 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:39.396963 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:39.397191 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:39.397427 (+ 236us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:39.398915 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:39.400000 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:39.401416 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:39.402183 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:39.402303 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:39.407091 (+ 4788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:39.407112 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:39.407132 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:39.407181 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:39.410389 (+ 3208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:39.411204 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:39.411211 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:39.411213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:39.411373 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:39.411829 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:39.411832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:39.411834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:39.412266 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:39.412536 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:39.412826 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 10:42:39.413081 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":349,"threads_started":1}
I20260807 10:42:39.414813 12207 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:39.500805 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12017
I20260807 10:42:39.530370 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11479
I20260807 10:42:39.531783 11568 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:39.640527 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 11479
2026-08-07T10:42:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4556 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:42:39 dist-test-slave-42z9 krb5kdc[12244](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:42:39 dist-test-slave-42z9 krb5kdc[12244](info): set up 2 sockets
Aug 07 10:42:39 dist-test-slave-42z9 krb5kdc[12244](info): commencing operation
krb5kdc: starting...
W20260807 10:42:40.852360 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:42:41 dist-test-slave-42z9 krb5kdc[12244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:42:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:42:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:42:41.093961 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:41729
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:41729
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:41.470052 12263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:41.470402 12263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:41.470548 12263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:41.478170 12263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:42:41.478322 12263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:41.478406 12263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:41.478497 12263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:42:41.478556 12263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:42:41.489472 12263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:41729
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:41729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:41.491114 12263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:41.492646 12263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:41.506259 12277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:41.506184 12280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:41.506793 12276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:41.507264 12263 server_base.cc:1034] running on GCE node
I20260807 10:42:41.508184 12263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:41.509936 12263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:41.511174 12263 hybrid_clock.cc:648] HybridClock initialized: now 1786099361511090 us; error 63 us; skew 500 ppm
I20260807 10:42:41.511572 12263 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:41 dist-test-slave-42z9 krb5kdc[12244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099361, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:41.517788 12263 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:42:41.519600 12263 webserver.cc:460] Webserver started at http://127.11.46.190:40203/ using document root <none> and password file <none>
I20260807 10:42:41.520397 12263 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:41.520534 12263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:41.520865 12263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:41.524365 12263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "8cbea969dd6a443ea50ed2fe234b1edc"
format_stamp: "Formatted at 2026-08-07 10:42:41 on dist-test-slave-42z9"
server_key: "10ab681cf664ca9eacb2583cd88acb19"
server_key_iv: "f3eaeab9b565abca9ebb6bca9e73ced6"
server_key_version: "encryptionkey@0"
I20260807 10:42:41.525218 12263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "8cbea969dd6a443ea50ed2fe234b1edc"
format_stamp: "Formatted at 2026-08-07 10:42:41 on dist-test-slave-42z9"
server_key: "10ab681cf664ca9eacb2583cd88acb19"
server_key_iv: "f3eaeab9b565abca9ebb6bca9e73ced6"
server_key_version: "encryptionkey@0"
I20260807 10:42:41.531337 12263 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260807 10:42:41.535442 12289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:41.536963 12263 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:42:41.537181 12263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "8cbea969dd6a443ea50ed2fe234b1edc"
format_stamp: "Formatted at 2026-08-07 10:42:41 on dist-test-slave-42z9"
server_key: "10ab681cf664ca9eacb2583cd88acb19"
server_key_iv: "f3eaeab9b565abca9ebb6bca9e73ced6"
server_key_version: "encryptionkey@0"
I20260807 10:42:41.537400 12263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:41.559806 12263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:41.564461 12263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:41.564797 12263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:41.584738 12263 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:41729
I20260807 10:42:41.584765 12372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:41729 every 8 connection(s)
I20260807 10:42:41.586529 12263 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:42:41.589579 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12263
I20260807 10:42:41.589859 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:42:41.590683 11450 external_mini_cluster.cc:1428] Setting key 3a814236dc4ee0b486987216f2a0e133
I20260807 10:42:41.591675 12373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:42:41 dist-test-slave-42z9 krb5kdc[12244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:41.607846 12373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc: Bootstrap starting.
I20260807 10:42:41.611912 12373 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:41.613376 12373 log.cc:824] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:41.616914 12376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:41.592910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47258 (local address 127.11.46.190:41729)
0807 10:42:41.593802 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:41.593815 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:41.593863 (+ 48us) server_negotiation.cc:407] Connection header received
0807 10:42:41.595609 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:41.595639 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:41.596130 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:41.596547 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:41.598611 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:41.600181 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:41.601958 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:41.602705 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:41.602876 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:41.608098 (+ 5222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:41.608110 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:41.608130 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:41.608182 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:41.611553 (+ 3371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:41.612574 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:41.612582 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:41.612590 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:41.612792 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:41.613240 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:41.613243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:41.613245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:41.613935 (+ 690us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:41.614293 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:41.614852 (+ 559us) server_negotiation.cc:299] Negotiation successful
0807 10:42:41.615400 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":399,"threads_started":1}
I20260807 10:42:41.617419 12373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc: No bootstrap required, opened a new log
I20260807 10:42:41.626410 12373 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbea969dd6a443ea50ed2fe234b1edc" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41729 } }
I20260807 10:42:41.626888 12373 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:41.626973 12373 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cbea969dd6a443ea50ed2fe234b1edc, State: Initialized, Role: FOLLOWER
I20260807 10:42:41.627581 12373 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbea969dd6a443ea50ed2fe234b1edc" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41729 } }
I20260807 10:42:41.627827 12373 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:42:41.627956 12373 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:42:41.628105 12373 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:41.631009 12373 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbea969dd6a443ea50ed2fe234b1edc" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41729 } }
I20260807 10:42:41.631626 12373 leader_election.cc:302] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cbea969dd6a443ea50ed2fe234b1edc; no voters:
I20260807 10:42:41.632261 12373 leader_election.cc:288] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:42:41.632423 12379 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:41.633427 12379 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [term 1 LEADER]: Becoming Leader. State: Replica: 8cbea969dd6a443ea50ed2fe234b1edc, State: Running, Role: LEADER
I20260807 10:42:41.634070 12379 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbea969dd6a443ea50ed2fe234b1edc" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41729 } }
I20260807 10:42:41.634516 12373 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:42:41.638072 12380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cbea969dd6a443ea50ed2fe234b1edc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbea969dd6a443ea50ed2fe234b1edc" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41729 } } }
I20260807 10:42:41.638780 12380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:41.638248 12381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cbea969dd6a443ea50ed2fe234b1edc. Latest consensus state: current_term: 1 leader_uuid: "8cbea969dd6a443ea50ed2fe234b1edc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cbea969dd6a443ea50ed2fe234b1edc" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41729 } } }
I20260807 10:42:41.639972 12389 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:42:41.640867 12381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:41.647320 12389 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:42:41.658161 12389 catalog_manager.cc:1347] Generated new cluster ID: bb5af77710ae44cb89dce7c6d4b4812d
I20260807 10:42:41.658313 12389 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:42:41.689882 12389 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:42:41.691407 12389 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:42:41.704945 12389 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cbea969dd6a443ea50ed2fe234b1edc: Generated new TSK 0
I20260807 10:42:41.706063 12389 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:42:41.765736 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41729
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:42.151108 12411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:42.151489 12411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:42.151648 12411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:42.159463 12411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:42.159648 12411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:42.159821 12411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:42:42.171049 12411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41729
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:42.172585 12411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:42.174233 12411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:42.189584 12416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:42.189601 12417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:42.189642 12419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:42.191007 12411 server_base.cc:1034] running on GCE node
I20260807 10:42:42.191745 12411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:42.192873 12411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:42.194095 12411 hybrid_clock.cc:648] HybridClock initialized: now 1786099362194034 us; error 46 us; skew 500 ppm
I20260807 10:42:42.194474 12411 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:42 dist-test-slave-42z9 krb5kdc[12244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099362, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:42.198019 12411 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:42:42.199766 12411 webserver.cc:460] Webserver started at http://127.11.46.129:40835/ using document root <none> and password file <none>
I20260807 10:42:42.200598 12411 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:42.200769 12411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:42.201155 12411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:42.204761 12411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "f020df0eb6964319a06d316297679eb5"
format_stamp: "Formatted at 2026-08-07 10:42:42 on dist-test-slave-42z9"
server_key: "2ab44743d772ed49337d56719c13712d"
server_key_iv: "e43c1333fdb21841600774404c1f7d2c"
server_key_version: "encryptionkey@0"
I20260807 10:42:42.205788 12411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "f020df0eb6964319a06d316297679eb5"
format_stamp: "Formatted at 2026-08-07 10:42:42 on dist-test-slave-42z9"
server_key: "2ab44743d772ed49337d56719c13712d"
server_key_iv: "e43c1333fdb21841600774404c1f7d2c"
server_key_version: "encryptionkey@0"
I20260807 10:42:42.211869 12411 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:42:42.215962 12429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:42.217603 12411 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:42:42.217805 12411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "f020df0eb6964319a06d316297679eb5"
format_stamp: "Formatted at 2026-08-07 10:42:42 on dist-test-slave-42z9"
server_key: "2ab44743d772ed49337d56719c13712d"
server_key_iv: "e43c1333fdb21841600774404c1f7d2c"
server_key_version: "encryptionkey@0"
I20260807 10:42:42.218053 12411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:42.238996 12411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:42.244405 12411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:42.244769 12411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:42.246011 12411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:42:42.247969 12411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:42.248075 12411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:42.248219 12411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:42.248277 12411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:42.283823 12411 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:33277
I20260807 10:42:42.283854 12603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:33277 every 8 connection(s)
I20260807 10:42:42.285343 12411 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:42:42.292989 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12411
I20260807 10:42:42.293216 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:42:42.293893 11450 external_mini_cluster.cc:1428] Setting key 009e6d69fd58c76319577c5bb6395b07
Aug 07 10:42:42 dist-test-slave-42z9 krb5kdc[12244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099362, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:42.307830 12606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:42.288408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:48567 (local address 127.11.46.190:41729)
0807 10:42:42.289150 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:42.289156 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:42.290229 (+ 1073us) server_negotiation.cc:407] Connection header received
0807 10:42:42.292322 (+ 2093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:42.292329 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:42.292435 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:42.292541 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:42.294508 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:42.295292 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:42.297016 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:42.297486 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:42.297619 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:42.301489 (+ 3870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:42.301499 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:42.301507 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:42.301565 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:42.304159 (+ 2594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:42.305145 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:42.305151 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:42.305155 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:42.305308 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:42.305840 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:42.305844 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:42.305846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:42.306163 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:42.306315 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:42.307153 (+ 838us) server_negotiation.cc:299] Negotiation successful
0807 10:42:42.307427 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":345,"threads_started":1}
I20260807 10:42:42.308948 12609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:42.289073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:41729 (local address 127.11.46.129:48567)
0807 10:42:42.290006 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:42.290064 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:42.291948 (+ 1884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:42.292854 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:42.292864 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:42.293596 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:42.294302 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:42.294325 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:42.295491 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:42.295496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:42.296844 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:42.296860 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:42.297752 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:42.297760 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:42.298014 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:42.298719 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:42.298752 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:42.301172 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:42.304379 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:42.304389 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:42.304406 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:42.304952 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:42.305470 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:42.305477 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:42.305481 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:42.305716 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:42.306304 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:42.306313 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:42.306716 (+ 403us) client_negotiation.cc:769] Sending connection context
0807 10:42:42.306994 (+ 278us) client_negotiation.cc:240] Negotiation successful
0807 10:42:42.307631 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":393,"threads_started":1}
I20260807 10:42:42.311049 12604 heartbeater.cc:347] Connected to a master server at 127.11.46.190:41729
I20260807 10:42:42.311471 12604 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:42.312645 12604 heartbeater.cc:511] Master 127.11.46.190:41729 requested a full tablet report, sending...
I20260807 10:42:42.315940 12316 ts_manager.cc:194] Registered new tserver with Master: f020df0eb6964319a06d316297679eb5 (127.11.46.129:33277)
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
I20260807 10:42:42.317763 12316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:48567
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:42:42.348534 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41729
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:42.732349 12614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:42.732713 12614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:42.732831 12614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:42.740880 12614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:42.741034 12614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:42.741189 12614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:42:42.752048 12614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41729
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:42.753657 12614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:42.755208 12614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:42.771360 12623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:42.771483 12624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:42.771486 12626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:42.772403 12614 server_base.cc:1034] running on GCE node
I20260807 10:42:42.773102 12614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:42.774279 12614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:42.775513 12614 hybrid_clock.cc:648] HybridClock initialized: now 1786099362775464 us; error 55 us; skew 500 ppm
I20260807 10:42:42.775887 12614 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:42 dist-test-slave-42z9 krb5kdc[12244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099362, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:42.780234 12614 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:42:42.782243 12614 webserver.cc:460] Webserver started at http://127.11.46.130:42097/ using document root <none> and password file <none>
I20260807 10:42:42.783088 12614 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:42.783239 12614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:42.783632 12614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:42.787215 12614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "9807d36cf077462f84e0be4b89aa2aeb"
format_stamp: "Formatted at 2026-08-07 10:42:42 on dist-test-slave-42z9"
server_key: "64774083e8ea9342862c36de255bd532"
server_key_iv: "a746c8b0068c947838885b8b1b61e846"
server_key_version: "encryptionkey@0"
I20260807 10:42:42.788283 12614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "9807d36cf077462f84e0be4b89aa2aeb"
format_stamp: "Formatted at 2026-08-07 10:42:42 on dist-test-slave-42z9"
server_key: "64774083e8ea9342862c36de255bd532"
server_key_iv: "a746c8b0068c947838885b8b1b61e846"
server_key_version: "encryptionkey@0"
I20260807 10:42:42.794816 12614 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260807 10:42:42.799279 12634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:42.801062 12614 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260807 10:42:42.801293 12614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "9807d36cf077462f84e0be4b89aa2aeb"
format_stamp: "Formatted at 2026-08-07 10:42:42 on dist-test-slave-42z9"
server_key: "64774083e8ea9342862c36de255bd532"
server_key_iv: "a746c8b0068c947838885b8b1b61e846"
server_key_version: "encryptionkey@0"
I20260807 10:42:42.801617 12614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:42.832239 12614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:42.836943 12614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:42.837240 12614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:42.838372 12614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:42:42.839890 12614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:42.839979 12614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:42.840116 12614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:42.840173 12614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:42.876533 12614 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:38051
I20260807 10:42:42.876586 12801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:38051 every 8 connection(s)
I20260807 10:42:42.878116 12614 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:42:42.886727 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12614
I20260807 10:42:42.886981 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:42:42.887583 11450 external_mini_cluster.cc:1428] Setting key 4e5d6aa9c2c0b968ac061cf40f71ff18
Aug 07 10:42:42 dist-test-slave-42z9 krb5kdc[12244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099362, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:42.904498 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:42.881172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:57377 (local address 127.11.46.190:41729)
0807 10:42:42.881704 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:42.881708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:42.882847 (+ 1139us) server_negotiation.cc:407] Connection header received
0807 10:42:42.885037 (+ 2190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:42.885043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:42.885142 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:42.885245 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:42.887619 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:42.888550 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:42.890860 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:42.891328 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:42.891443 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:42.896625 (+ 5182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:42.896634 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:42.896640 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:42.896709 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:42.900173 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:42.901497 (+ 1324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:42.901504 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:42.901507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:42.901729 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:42.902246 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:42.902252 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:42.902256 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:42.902651 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:42.902860 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:42.903788 (+ 928us) server_negotiation.cc:299] Negotiation successful
0807 10:42:42.904076 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":292,"threads_started":1}
I20260807 10:42:42.905354 12805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:42.881790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:41729 (local address 127.11.46.130:57377)
0807 10:42:42.882655 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:42.882703 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:42.884657 (+ 1954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:42.885633 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:42.885644 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:42.886327 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:42.887353 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:42.887387 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:42.888776 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:42.888782 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:42.890655 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:42.890678 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:42.891627 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:42.891635 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:42.891988 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:42.892809 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:42.892843 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:42.896007 (+ 3164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:42.900433 (+ 4426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:42.900448 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:42.900474 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:42.901266 (+ 792us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:42.901846 (+ 580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:42.901849 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:42.901852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:42.902104 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:42.902787 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:42.902798 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:42.903341 (+ 543us) client_negotiation.cc:769] Sending connection context
0807 10:42:42.903603 (+ 262us) client_negotiation.cc:240] Negotiation successful
0807 10:42:42.904099 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":311,"threads_started":1}
I20260807 10:42:42.907187 12802 heartbeater.cc:347] Connected to a master server at 127.11.46.190:41729
I20260807 10:42:42.907614 12802 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:42.908658 12802 heartbeater.cc:511] Master 127.11.46.190:41729 requested a full tablet report, sending...
I20260807 10:42:42.910835 12316 ts_manager.cc:194] Registered new tserver with Master: 9807d36cf077462f84e0be4b89aa2aeb (127.11.46.130:38051)
I20260807 10:42:42.911741 12316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:57377
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:42:42.945827 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41729
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:42:43.322280 12604 heartbeater.cc:503] Master 127.11.46.190:41729 was elected leader, sending a full tablet report...
W20260807 10:42:43.332368 12808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:43.332728 12808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:43.332832 12808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:43.340724 12808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:43.340865 12808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:43.340989 12808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:42:43.351747 12808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41729
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:43.353276 12808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:43.354893 12808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:43.369614 12819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:43.369575 12817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:43.369536 12821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:43.370589 12808 server_base.cc:1034] running on GCE node
I20260807 10:42:43.371328 12808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:43.372488 12808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:43.373728 12808 hybrid_clock.cc:648] HybridClock initialized: now 1786099363373666 us; error 58 us; skew 500 ppm
I20260807 10:42:43.374099 12808 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:43 dist-test-slave-42z9 krb5kdc[12244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099363, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:43.377748 12808 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:42:43.379591 12808 webserver.cc:460] Webserver started at http://127.11.46.131:33075/ using document root <none> and password file <none>
I20260807 10:42:43.380455 12808 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:43.380585 12808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:43.380900 12808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:43.384356 12808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "a32e2dcc31904904946a58c9737bf6ee"
format_stamp: "Formatted at 2026-08-07 10:42:43 on dist-test-slave-42z9"
server_key: "b840f7376aa5594a7a263b9d2c60f583"
server_key_iv: "48dd8911fb569835c610047b7f0d3a6d"
server_key_version: "encryptionkey@0"
I20260807 10:42:43.385281 12808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "a32e2dcc31904904946a58c9737bf6ee"
format_stamp: "Formatted at 2026-08-07 10:42:43 on dist-test-slave-42z9"
server_key: "b840f7376aa5594a7a263b9d2c60f583"
server_key_iv: "48dd8911fb569835c610047b7f0d3a6d"
server_key_version: "encryptionkey@0"
I20260807 10:42:43.391721 12808 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260807 10:42:43.396310 12835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:43.397922 12808 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 10:42:43.398098 12808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "a32e2dcc31904904946a58c9737bf6ee"
format_stamp: "Formatted at 2026-08-07 10:42:43 on dist-test-slave-42z9"
server_key: "b840f7376aa5594a7a263b9d2c60f583"
server_key_iv: "48dd8911fb569835c610047b7f0d3a6d"
server_key_version: "encryptionkey@0"
I20260807 10:42:43.398300 12808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:43.424779 12808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:43.429823 12808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:43.430133 12808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:43.431291 12808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:42:43.432979 12808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:43.433076 12808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:43.433183 12808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:43.433228 12808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:43.468048 12808 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:33177
I20260807 10:42:43.468135 12999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:33177 every 8 connection(s)
I20260807 10:42:43.469565 12808 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:42:43.478375 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12808
I20260807 10:42:43.478575 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:42:43.478984 11450 external_mini_cluster.cc:1428] Setting key 926add1d408f7360500c11b7064adfa9
Aug 07 10:42:43 dist-test-slave-42z9 krb5kdc[12244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099363, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:43.491261 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.472501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:48213 (local address 127.11.46.190:41729)
0807 10:42:43.472985 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.472990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.474097 (+ 1107us) server_negotiation.cc:407] Connection header received
0807 10:42:43.476108 (+ 2011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.476114 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.476203 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.476303 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:43.478079 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.478921 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.480979 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.481528 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.481632 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.485539 (+ 3907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:43.485545 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:43.485549 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:43.485593 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:43.488121 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.488959 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.488963 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.488965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.489094 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.489599 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.489603 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.489605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.489902 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:43.490045 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.490766 (+ 721us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.490971 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":228,"threads_started":1}
I20260807 10:42:43.492270 13006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.473103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:41729 (local address 127.11.46.131:48213)
0807 10:42:43.473915 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:43.473964 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:43.475786 (+ 1822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:43.476590 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:43.476599 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:43.477173 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:43.477878 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.477898 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.479116 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.479122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.480823 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.480842 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.481778 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.481786 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.482108 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.482845 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:43.482872 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:43.485219 (+ 2347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:43.488294 (+ 3075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:43.488303 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:43.488320 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:43.488851 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:43.489183 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:43.489187 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:43.489189 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:43.489461 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:43.490022 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:43.490028 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:43.490400 (+ 372us) client_negotiation.cc:769] Sending connection context
0807 10:42:43.490664 (+ 264us) client_negotiation.cc:240] Negotiation successful
0807 10:42:43.491110 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":341,"threads_started":1}
I20260807 10:42:43.493884 13003 heartbeater.cc:347] Connected to a master server at 127.11.46.190:41729
I20260807 10:42:43.494225 13003 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:43.495105 13003 heartbeater.cc:511] Master 127.11.46.190:41729 requested a full tablet report, sending...
I20260807 10:42:43.496589 12316 ts_manager.cc:194] Registered new tserver with Master: a32e2dcc31904904946a58c9737bf6ee (127.11.46.131:33177)
I20260807 10:42:43.497489 12316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:48213
I20260807 10:42:43.508858 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:42:43.529556 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.516172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47262 (local address 127.11.46.190:41729)
0807 10:42:43.516391 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.516396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.516947 (+ 551us) server_negotiation.cc:407] Connection header received
0807 10:42:43.517216 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.517221 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.517301 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.517386 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:43.519031 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.519831 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.521111 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.521585 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.521693 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.524198 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:43.524204 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:43.524207 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:43.524249 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:43.526932 (+ 2683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.527676 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.527681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.527683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.527837 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.528214 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.528217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.528219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.528568 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:43.528766 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.529074 (+ 308us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.529268 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:42:43.536921 12316 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:42:43.544446 12316 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:42:43.585006 13028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.558767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33277 (local address 127.0.0.1:43962)
0807 10:42:43.569959 (+ 11192us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:43.570040 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:43.570320 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:43.573920 (+ 3600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:43.573929 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:43.573977 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:43.574466 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.574482 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.578478 (+ 3996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.578484 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.581423 (+ 2939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.581469 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.583430 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.583439 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.584008 (+ 569us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.584082 (+ 74us) client_negotiation.cc:769] Sending connection context
0807 10:42:43.584236 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 10:42:43.584564 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10756,"mutex_wait_us":42,"thread_start_us":20719,"threads_started":1}
I20260807 10:42:43.585029 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.559079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43962 (local address 127.11.46.129:33277)
0807 10:42:43.572972 (+ 13893us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.572984 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.573025 (+ 41us) server_negotiation.cc:407] Connection header received
0807 10:42:43.573174 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.573185 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.573562 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.573838 (+ 276us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:43.574746 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.578268 (+ 3522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.581645 (+ 3377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.583159 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.583356 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.583640 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.584429 (+ 789us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.584685 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13697,"thread_start_us":13539,"threads_started":1}
I20260807 10:42:43.588333 13019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.559405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:38051 (local address 127.0.0.1:57066)
0807 10:42:43.579869 (+ 20464us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:43.579889 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:43.580004 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:43.580703 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:43.580706 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:43.580730 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:43.581835 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.581846 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.583304 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.583309 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.585518 (+ 2209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.585535 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.587451 (+ 1916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.587458 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.587635 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.587676 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 10:42:43.587763 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 10:42:43.587908 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20343,"mutex_wait_us":1,"thread_start_us":11196,"threads_started":1}
I20260807 10:42:43.588407 13030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.560001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57066 (local address 127.11.46.130:38051)
0807 10:42:43.578414 (+ 18413us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.578423 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.580014 (+ 1591us) server_negotiation.cc:407] Connection header received
0807 10:42:43.580141 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.580149 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.580462 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.580690 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:43.582033 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.583161 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.585737 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.587167 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.587376 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.587600 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.587858 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.588069 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18199,"thread_start_us":18408,"threads_started":1}
I20260807 10:42:43.590258 12507 tablet_service.cc:1467] Processing CreateTablet for tablet 38ee299ce0d9464b806bb676b83527a4 (DEFAULT_TABLE table=test-table [id=fa5f7c3076874f4697df98ff3910990d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:43.592233 12507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38ee299ce0d9464b806bb676b83527a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:43.593135 12712 tablet_service.cc:1467] Processing CreateTablet for tablet 38ee299ce0d9464b806bb676b83527a4 (DEFAULT_TABLE table=test-table [id=fa5f7c3076874f4697df98ff3910990d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:43.594933 12712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38ee299ce0d9464b806bb676b83527a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:43.599016 13021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.558982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:33177 (local address 127.0.0.1:47986)
0807 10:42:43.571851 (+ 12869us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:43.571876 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:43.572016 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:43.578714 (+ 6698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:43.578719 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:43.578753 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:43.581763 (+ 3010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.581778 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.583774 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.583779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.595609 (+ 11830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.595633 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.598098 (+ 2465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.598107 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.598298 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.598338 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 10:42:43.598481 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 10:42:43.598635 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12723,"thread_start_us":12560,"threads_started":1}
I20260807 10:42:43.599951 13029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.559655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47986 (local address 127.11.46.131:33177)
0807 10:42:43.577068 (+ 17413us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.577079 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.577133 (+ 54us) server_negotiation.cc:407] Connection header received
0807 10:42:43.577256 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.577266 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.578254 (+ 988us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.578507 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:43.582014 (+ 3507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.583599 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.595905 (+ 12306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.597522 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.597665 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.597912 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.599328 (+ 1416us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.599592 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17181,"thread_start_us":18141,"threads_started":1}
I20260807 10:42:43.604318 12909 tablet_service.cc:1467] Processing CreateTablet for tablet 38ee299ce0d9464b806bb676b83527a4 (DEFAULT_TABLE table=test-table [id=fa5f7c3076874f4697df98ff3910990d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:43.606206 12909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38ee299ce0d9464b806bb676b83527a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:43.609714 13031 tablet_bootstrap.cc:492] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5: Bootstrap starting.
I20260807 10:42:43.614306 13033 tablet_bootstrap.cc:492] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb: Bootstrap starting.
I20260807 10:42:43.614987 13031 tablet_bootstrap.cc:654] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:43.616703 13031 log.cc:824] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:43.618147 13033 tablet_bootstrap.cc:654] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:43.619475 13033 log.cc:824] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:43.620644 13031 tablet_bootstrap.cc:492] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5: No bootstrap required, opened a new log
I20260807 10:42:43.620988 13031 ts_tablet_manager.cc:1397] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.002s
I20260807 10:42:43.621905 13037 tablet_bootstrap.cc:492] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee: Bootstrap starting.
I20260807 10:42:43.623629 13033 tablet_bootstrap.cc:492] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb: No bootstrap required, opened a new log
I20260807 10:42:43.624045 13033 ts_tablet_manager.cc:1397] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260807 10:42:43.626302 13037 tablet_bootstrap.cc:654] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:43.627810 13037 log.cc:824] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:43.630441 13031 raft_consensus.cc:348] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020df0eb6964319a06d316297679eb5" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33277 } } peers { permanent_uuid: "a32e2dcc31904904946a58c9737bf6ee" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33177 } } peers { permanent_uuid: "9807d36cf077462f84e0be4b89aa2aeb" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38051 } }
I20260807 10:42:43.630877 13031 raft_consensus.cc:374] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:43.631003 13031 raft_consensus.cc:729] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f020df0eb6964319a06d316297679eb5, State: Initialized, Role: FOLLOWER
I20260807 10:42:43.631835 13037 tablet_bootstrap.cc:492] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee: No bootstrap required, opened a new log
I20260807 10:42:43.631688 13031 consensus_queue.cc:260] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020df0eb6964319a06d316297679eb5" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33277 } } peers { permanent_uuid: "a32e2dcc31904904946a58c9737bf6ee" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33177 } } peers { permanent_uuid: "9807d36cf077462f84e0be4b89aa2aeb" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38051 } }
I20260807 10:42:43.632186 13037 ts_tablet_manager.cc:1397] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260807 10:42:43.633723 13031 ts_tablet_manager.cc:1428] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260807 10:42:43.634478 13033 raft_consensus.cc:348] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020df0eb6964319a06d316297679eb5" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33277 } } peers { permanent_uuid: "a32e2dcc31904904946a58c9737bf6ee" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33177 } } peers { permanent_uuid: "9807d36cf077462f84e0be4b89aa2aeb" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38051 } }
I20260807 10:42:43.635165 13033 raft_consensus.cc:374] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:43.635314 13033 raft_consensus.cc:729] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9807d36cf077462f84e0be4b89aa2aeb, State: Initialized, Role: FOLLOWER
I20260807 10:42:43.636281 13033 consensus_queue.cc:260] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020df0eb6964319a06d316297679eb5" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33277 } } peers { permanent_uuid: "a32e2dcc31904904946a58c9737bf6ee" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33177 } } peers { permanent_uuid: "9807d36cf077462f84e0be4b89aa2aeb" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38051 } }
I20260807 10:42:43.638010 12802 heartbeater.cc:503] Master 127.11.46.190:41729 was elected leader, sending a full tablet report...
I20260807 10:42:43.638727 13033 ts_tablet_manager.cc:1428] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb: Time spent starting tablet: real 0.014s user 0.008s sys 0.004s
I20260807 10:42:43.642879 13037 raft_consensus.cc:348] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020df0eb6964319a06d316297679eb5" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33277 } } peers { permanent_uuid: "a32e2dcc31904904946a58c9737bf6ee" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33177 } } peers { permanent_uuid: "9807d36cf077462f84e0be4b89aa2aeb" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38051 } }
I20260807 10:42:43.643400 13037 raft_consensus.cc:374] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:43.643492 13037 raft_consensus.cc:729] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a32e2dcc31904904946a58c9737bf6ee, State: Initialized, Role: FOLLOWER
I20260807 10:42:43.644090 13037 consensus_queue.cc:260] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020df0eb6964319a06d316297679eb5" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33277 } } peers { permanent_uuid: "a32e2dcc31904904946a58c9737bf6ee" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33177 } } peers { permanent_uuid: "9807d36cf077462f84e0be4b89aa2aeb" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38051 } }
I20260807 10:42:43.645258 13003 heartbeater.cc:503] Master 127.11.46.190:41729 was elected leader, sending a full tablet report...
I20260807 10:42:43.646132 13037 ts_tablet_manager.cc:1428] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260807 10:42:43.650406 13043 raft_consensus.cc:482] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:42:43.650714 13043 raft_consensus.cc:504] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020df0eb6964319a06d316297679eb5" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33277 } } peers { permanent_uuid: "a32e2dcc31904904946a58c9737bf6ee" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33177 } } peers { permanent_uuid: "9807d36cf077462f84e0be4b89aa2aeb" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38051 } }
I20260807 10:42:43.652601 13043 leader_election.cc:288] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f020df0eb6964319a06d316297679eb5 (127.11.46.129:33277), 9807d36cf077462f84e0be4b89aa2aeb (127.11.46.130:38051)
I20260807 10:42:43.659145 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.653027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:52189 (local address 127.11.46.129:33277)
0807 10:42:43.653246 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.653252 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.653275 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:42:43.653428 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.653433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.653539 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.653633 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:43.654213 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.655222 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.657112 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.658257 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.658389 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.658450 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.658801 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.658912 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:42:43.659269 13006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.652885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33277 (local address 127.11.46.131:52189)
0807 10:42:43.653115 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:43.653137 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:43.653270 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:43.653827 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:43.653830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:43.653863 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:43.654056 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.654069 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.655359 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.655365 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.656932 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.656948 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.658418 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.658424 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.658635 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.658677 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 10:42:43.658785 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 10:42:43.658936 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66,"mutex_wait_us":1}
I20260807 10:42:43.659994 13030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.653530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:49427 (local address 127.11.46.130:38051)
0807 10:42:43.653764 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.653769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.654017 (+ 248us) server_negotiation.cc:407] Connection header received
0807 10:42:43.654158 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.654163 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.654239 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.654307 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:43.654930 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.655845 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.657905 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.658967 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.659120 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.659193 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.659583 (+ 390us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.659727 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 10:42:43.660058 13046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.653050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:38051 (local address 127.11.46.131:49427)
0807 10:42:43.653916 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:43.653931 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:43.654040 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:43.654357 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:43.654361 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:43.654395 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:43.654784 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.654797 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.656014 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.656018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.657736 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:43.657753 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.659196 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.659202 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:43.659405 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.659437 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 10:42:43.659527 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 10:42:43.659668 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"mutex_wait_us":24,"thread_start_us":506,"threads_started":1}
I20260807 10:42:43.660521 12535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38ee299ce0d9464b806bb676b83527a4" candidate_uuid: "a32e2dcc31904904946a58c9737bf6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020df0eb6964319a06d316297679eb5" is_pre_election: true
I20260807 10:42:43.661010 12737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38ee299ce0d9464b806bb676b83527a4" candidate_uuid: "a32e2dcc31904904946a58c9737bf6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9807d36cf077462f84e0be4b89aa2aeb" is_pre_election: true
I20260807 10:42:43.661116 12535 raft_consensus.cc:2454] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a32e2dcc31904904946a58c9737bf6ee in term 0.
I20260807 10:42:43.661520 12737 raft_consensus.cc:2454] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a32e2dcc31904904946a58c9737bf6ee in term 0.
I20260807 10:42:43.661900 12836 leader_election.cc:302] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a32e2dcc31904904946a58c9737bf6ee, f020df0eb6964319a06d316297679eb5; no voters:
I20260807 10:42:43.662424 13043 raft_consensus.cc:2781] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:42:43.662590 13043 raft_consensus.cc:482] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:42:43.662689 13043 raft_consensus.cc:3037] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:43.665594 13043 raft_consensus.cc:504] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020df0eb6964319a06d316297679eb5" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33277 } } peers { permanent_uuid: "a32e2dcc31904904946a58c9737bf6ee" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33177 } } peers { permanent_uuid: "9807d36cf077462f84e0be4b89aa2aeb" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38051 } }
I20260807 10:42:43.666316 13043 leader_election.cc:288] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [CANDIDATE]: Term 1 election: Requested vote from peers f020df0eb6964319a06d316297679eb5 (127.11.46.129:33277), 9807d36cf077462f84e0be4b89aa2aeb (127.11.46.130:38051)
I20260807 10:42:43.666875 12535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38ee299ce0d9464b806bb676b83527a4" candidate_uuid: "a32e2dcc31904904946a58c9737bf6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020df0eb6964319a06d316297679eb5"
I20260807 10:42:43.666890 12737 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38ee299ce0d9464b806bb676b83527a4" candidate_uuid: "a32e2dcc31904904946a58c9737bf6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9807d36cf077462f84e0be4b89aa2aeb"
I20260807 10:42:43.667096 12535 raft_consensus.cc:3037] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:43.667100 12737 raft_consensus.cc:3037] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:43.669598 12737 raft_consensus.cc:2454] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a32e2dcc31904904946a58c9737bf6ee in term 1.
I20260807 10:42:43.669606 12535 raft_consensus.cc:2454] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a32e2dcc31904904946a58c9737bf6ee in term 1.
I20260807 10:42:43.670166 12843 leader_election.cc:302] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9807d36cf077462f84e0be4b89aa2aeb, a32e2dcc31904904946a58c9737bf6ee; no voters:
I20260807 10:42:43.670531 13043 raft_consensus.cc:2781] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:43.671013 13043 raft_consensus.cc:686] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [term 1 LEADER]: Becoming Leader. State: Replica: a32e2dcc31904904946a58c9737bf6ee, State: Running, Role: LEADER
I20260807 10:42:43.671554 13043 consensus_queue.cc:237] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020df0eb6964319a06d316297679eb5" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33277 } } peers { permanent_uuid: "a32e2dcc31904904946a58c9737bf6ee" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33177 } } peers { permanent_uuid: "9807d36cf077462f84e0be4b89aa2aeb" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38051 } }
I20260807 10:42:43.677348 12316 catalog_manager.cc:5495] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to a32e2dcc31904904946a58c9737bf6ee (127.11.46.131). New cstate: current_term: 1 leader_uuid: "a32e2dcc31904904946a58c9737bf6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020df0eb6964319a06d316297679eb5" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a32e2dcc31904904946a58c9737bf6ee" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9807d36cf077462f84e0be4b89aa2aeb" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38051 } health_report { overall_health: UNKNOWN } } }
Aug 07 10:42:43 dist-test-slave-42z9 krb5kdc[12244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:42:43.702735 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.687009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43964 (local address 127.11.46.129:33277)
0807 10:42:43.687204 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.687208 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.687774 (+ 566us) server_negotiation.cc:407] Connection header received
0807 10:42:43.687920 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.687924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.688003 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.688113 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:43.689755 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.690539 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.691898 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.692349 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.692481 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.696720 (+ 4239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:43.696740 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:43.696760 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:43.696806 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:43.699831 (+ 3025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.700655 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.700664 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.700666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.700831 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.701166 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.701169 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.701171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.701628 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:43.701906 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.702134 (+ 228us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.702335 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 10:42:43.721349 13004 tablet.cc:2369] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 10:42:43 dist-test-slave-42z9 krb5kdc[12244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099363, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 10:42:43 dist-test-slave-42z9 krb5kdc[12244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099363, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:42:43.762585 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.748053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43978 (local address 127.11.46.129:33277)
0807 10:42:43.748288 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.748295 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.748673 (+ 378us) server_negotiation.cc:407] Connection header received
0807 10:42:43.748855 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.748859 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.748932 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.749029 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:43.750553 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.751358 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.752671 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.753131 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.753252 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.757623 (+ 4371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:43.757629 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:43.757633 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:43.757679 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:43.760147 (+ 2468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.760838 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.760842 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.760844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.761005 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.761312 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.761315 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.761317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.761657 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:43.761893 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.762107 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.762311 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260807 10:42:43.788508 12605 tablet.cc:2369] T 38ee299ce0d9464b806bb676b83527a4 P f020df0eb6964319a06d316297679eb5: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 10:42:43 dist-test-slave-42z9 krb5kdc[12244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 10:42:43 dist-test-slave-42z9 krb5kdc[12244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:42:43.820988 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.806487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43984 (local address 127.11.46.129:33277)
0807 10:42:43.806682 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.806690 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.807124 (+ 434us) server_negotiation.cc:407] Connection header received
0807 10:42:43.807314 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.807319 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.807401 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.807491 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:43.808948 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.809729 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.811091 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.811592 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.811707 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.815675 (+ 3968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:43.815680 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:43.815683 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:43.815723 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:43.818224 (+ 2501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.818911 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.818917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.818919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.819059 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.819450 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.819455 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.819457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.819804 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:43.820059 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.820379 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.820629 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 10:42:43.823042 12475 tablet_service.cc:2908] Rejecting scan request for tablet 38ee299ce0d9464b806bb676b83527a4: Uninitialized: clean time has not yet been initialized
I20260807 10:42:43.826442 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12411
I20260807 10:42:43.840166 13026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.827840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43996 (local address 127.11.46.129:33277)
0807 10:42:43.828086 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.828092 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.828254 (+ 162us) server_negotiation.cc:407] Connection header received
0807 10:42:43.828443 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.828448 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.828520 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.828607 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:43.829898 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.830624 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.831881 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.832350 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.832475 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.835027 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:43.835032 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:43.835036 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:43.835075 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:43.837603 (+ 2528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.838355 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.838361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.838364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.838513 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.838823 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.838825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.838827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.839155 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:43.839411 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.839620 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.839836 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 10:42:43.841034 12598 generic_service.cc:196] Checking for leaks (request via RPC)
W20260807 10:42:43.880676 12803 tablet.cc:2369] T 38ee299ce0d9464b806bb676b83527a4 P 9807d36cf077462f84e0be4b89aa2aeb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:42:43.945870 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12411
I20260807 10:42:43.979156 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12614
Aug 07 10:42:43 dist-test-slave-42z9 krb5kdc[12244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:42:43.996901 13030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:43.980551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57072 (local address 127.11.46.130:38051)
0807 10:42:43.980732 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:43.980736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:43.980757 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:42:43.980828 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:43.980833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:43.980904 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:43.980996 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:43.982327 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.983162 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.984460 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:43.984866 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:43.984965 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:43.989321 (+ 4356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:43.989347 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:43.989370 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:43.989424 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:43.992872 (+ 3448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.994522 (+ 1650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.994533 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.994536 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.994750 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:43.995197 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:43.995200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:43.995202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:43.995681 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:43.996027 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:43.996268 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 10:42:43.996532 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:42:43.997738 12795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:44.091339 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12614
I20260807 10:42:44.124495 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12808
Aug 07 10:42:44 dist-test-slave-42z9 krb5kdc[12244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:42:44.139138 13046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:44.138622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33277 (local address 127.11.46.131:52663)
0807 10:42:44.138842 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:44.138969 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260807 10:42:44.139441 12836 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33277: connect: Connection refused (error 111)
I20260807 10:42:44.141116 13046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:44.140702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33277 (local address 127.11.46.131:36497)
0807 10:42:44.140868 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:44.140952 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33277: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:42:44.141500 12836 consensus_peers.cc:487] T 38ee299ce0d9464b806bb676b83527a4 P a32e2dcc31904904946a58c9737bf6ee -> Peer f020df0eb6964319a06d316297679eb5 (127.11.46.129:33277): Couldn't send request to peer f020df0eb6964319a06d316297679eb5. Status: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33277: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 10:42:44.142040 13067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:44.125335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47994 (local address 127.11.46.131:33177)
0807 10:42:44.125883 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:44.125887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:44.125904 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:42:44.125963 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:44.125967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:44.126043 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:44.126145 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:44.127537 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:44.128334 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:44.129909 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:44.130373 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:44.130507 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:44.135248 (+ 4741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:44.135273 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:44.135297 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:44.135370 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:44.138623 (+ 3253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:44.139566 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:44.139577 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:44.139580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:44.139777 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:44.140234 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:44.140239 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:44.140241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:44.140689 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:44.141015 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:44.141381 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 10:42:44.141699 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":298,"threads_started":1}
I20260807 10:42:44.142747 12994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:44.237780 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12808
I20260807 10:42:44.269068 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12263
I20260807 10:42:44.270732 12367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:44.387720 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12263
2026-08-07T10:42:44Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4747 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:42:44 dist-test-slave-42z9 krb5kdc[13077](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:42:44 dist-test-slave-42z9 krb5kdc[13077](info): set up 2 sockets
Aug 07 10:42:44 dist-test-slave-42z9 krb5kdc[13077](info): commencing operation
krb5kdc: starting...
W20260807 10:42:45.618016 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.003s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:42:45 dist-test-slave-42z9 krb5kdc[13077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:42:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:42:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:42:45.868738 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36587
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:36693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:36587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:46.234023 13100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:46.234390 13100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:46.234522 13100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:46.242453 13100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:42:46.242605 13100 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 10:42:46.242676 13100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:46.242763 13100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:46.242830 13100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:42:46.242914 13100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:42:46.253760 13100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:36693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:36587
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:46.255265 13100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:46.256816 13100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:46.270180 13111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:46.270346 13108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:46.270344 13107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:46.271797 13100 server_base.cc:1034] running on GCE node
I20260807 10:42:46.273306 13100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:46.275676 13100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:46.277042 13100 hybrid_clock.cc:648] HybridClock initialized: now 1786099366276925 us; error 63 us; skew 500 ppm
I20260807 10:42:46.277622 13100 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:46 dist-test-slave-42z9 krb5kdc[13077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099366, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:46.281823 13100 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:42:46.284121 13100 webserver.cc:460] Webserver started at http://127.11.46.190:42729/ using document root <none> and password file <none>
I20260807 10:42:46.285140 13100 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:46.285282 13100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:46.285755 13100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:46.289599 13100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "25ef902ab91f4c1c8270baf27c9b5b83"
format_stamp: "Formatted at 2026-08-07 10:42:46 on dist-test-slave-42z9"
server_key: "7933193d021378ba9eae3dde37526ec9"
server_key_iv: "369b326686b79f51f9239b6d30c97b5e"
server_key_version: "encryptionkey@0"
I20260807 10:42:46.290606 13100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "25ef902ab91f4c1c8270baf27c9b5b83"
format_stamp: "Formatted at 2026-08-07 10:42:46 on dist-test-slave-42z9"
server_key: "7933193d021378ba9eae3dde37526ec9"
server_key_iv: "369b326686b79f51f9239b6d30c97b5e"
server_key_version: "encryptionkey@0"
I20260807 10:42:46.297422 13100 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 10:42:46.302136 13122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:46.303917 13100 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:42:46.304180 13100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "25ef902ab91f4c1c8270baf27c9b5b83"
format_stamp: "Formatted at 2026-08-07 10:42:46 on dist-test-slave-42z9"
server_key: "7933193d021378ba9eae3dde37526ec9"
server_key_iv: "369b326686b79f51f9239b6d30c97b5e"
server_key_version: "encryptionkey@0"
I20260807 10:42:46.304446 13100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:46.323230 13100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:46.328383 13100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:46.328702 13100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:46.352725 13100 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:36587
I20260807 10:42:46.352730 13206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:36587 every 8 connection(s)
I20260807 10:42:46.354351 13100 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:42:46.358911 13207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:46.364482 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 13100
I20260807 10:42:46.364770 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:42:46.365682 11450 external_mini_cluster.cc:1428] Setting key 5319331728395290b48417f41d7844e3
I20260807 10:42:46.372526 13207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83: Bootstrap starting.
I20260807 10:42:46.376341 13207 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:46.377657 13207 log.cc:824] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:46.381037 13207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83: No bootstrap required, opened a new log
Aug 07 10:42:46 dist-test-slave-42z9 krb5kdc[13077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:46.389590 13207 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ef902ab91f4c1c8270baf27c9b5b83" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36587 } }
I20260807 10:42:46.390116 13207 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:46.390239 13207 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25ef902ab91f4c1c8270baf27c9b5b83, State: Initialized, Role: FOLLOWER
I20260807 10:42:46.390931 13207 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ef902ab91f4c1c8270baf27c9b5b83" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36587 } }
I20260807 10:42:46.391112 13211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:46.368207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47442 (local address 127.11.46.190:36587)
0807 10:42:46.369178 (+ 971us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:46.369193 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:46.369246 (+ 53us) server_negotiation.cc:407] Connection header received
0807 10:42:46.371256 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:46.371287 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:46.371802 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:46.372241 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:46.373961 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:46.375428 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:46.376864 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:46.377700 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:46.377908 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:46.382603 (+ 4695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:46.382612 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:46.382632 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:46.382677 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:46.386216 (+ 3539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:46.387089 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:46.387102 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:46.387111 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:46.387335 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:46.387793 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:46.387798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:46.387804 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:46.388514 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:46.388839 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:46.389387 (+ 548us) server_negotiation.cc:299] Negotiation successful
0807 10:42:46.389907 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":410,"threads_started":1}
I20260807 10:42:46.391223 13207 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:42:46.391383 13207 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:42:46.391592 13207 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:46.394286 13207 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ef902ab91f4c1c8270baf27c9b5b83" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36587 } }
I20260807 10:42:46.394912 13207 leader_election.cc:302] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25ef902ab91f4c1c8270baf27c9b5b83; no voters:
I20260807 10:42:46.395538 13207 leader_election.cc:288] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:42:46.395695 13215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:46.397006 13215 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [term 1 LEADER]: Becoming Leader. State: Replica: 25ef902ab91f4c1c8270baf27c9b5b83, State: Running, Role: LEADER
I20260807 10:42:46.397746 13215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ef902ab91f4c1c8270baf27c9b5b83" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36587 } }
I20260807 10:42:46.397977 13207 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:42:46.401101 13217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25ef902ab91f4c1c8270baf27c9b5b83. Latest consensus state: current_term: 1 leader_uuid: "25ef902ab91f4c1c8270baf27c9b5b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ef902ab91f4c1c8270baf27c9b5b83" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36587 } } }
I20260807 10:42:46.401754 13217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:46.401588 13216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25ef902ab91f4c1c8270baf27c9b5b83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25ef902ab91f4c1c8270baf27c9b5b83" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36587 } } }
I20260807 10:42:46.402477 13216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83 [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:46.405993 13227 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:42:46.412596 13227 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:42:46.422925 13227 catalog_manager.cc:1347] Generated new cluster ID: ce19f1a8c6824270a46aa3e8aa769d16
I20260807 10:42:46.423087 13227 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:42:46.461004 13227 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:42:46.462598 13227 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:42:46.470507 13227 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83: Generated new TSK 0
I20260807 10:42:46.471575 13227 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:42:46.541746 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36587
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:36693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:46.951525 13243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:46.951859 13243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:46.951979 13243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:46.959615 13243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:46.959777 13243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:46.959877 13243 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:42:46.959961 13243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:42:46.970669 13243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:36693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.46.190:36587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:46.972127 13243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:46.973681 13243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:46.988693 13251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:46.988667 13257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:46.988665 13254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:46.989112 13243 server_base.cc:1034] running on GCE node
I20260807 10:42:46.990154 13243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:46.991245 13243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:46.992539 13243 hybrid_clock.cc:648] HybridClock initialized: now 1786099366992446 us; error 50 us; skew 500 ppm
I20260807 10:42:46.992895 13243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:46 dist-test-slave-42z9 krb5kdc[13077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099366, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:47.000870 13243 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:42:47.002897 13243 webserver.cc:460] Webserver started at http://127.11.46.129:39543/ using document root <none> and password file <none>
I20260807 10:42:47.003940 13243 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:47.004072 13243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:47.004470 13243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:47.008042 13243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "8015e00c9a71452681cf87ea7f0ec4b3"
format_stamp: "Formatted at 2026-08-07 10:42:46 on dist-test-slave-42z9"
server_key: "2b9dfacf0d36a37489fa2716ac3170fe"
server_key_iv: "9cf0d1b50ce891f1d6a481cf24e14569"
server_key_version: "encryptionkey@0"
I20260807 10:42:47.009016 13243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "8015e00c9a71452681cf87ea7f0ec4b3"
format_stamp: "Formatted at 2026-08-07 10:42:46 on dist-test-slave-42z9"
server_key: "2b9dfacf0d36a37489fa2716ac3170fe"
server_key_iv: "9cf0d1b50ce891f1d6a481cf24e14569"
server_key_version: "encryptionkey@0"
I20260807 10:42:47.015471 13243 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:42:47.019871 13270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:47.021692 13243 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:42:47.021898 13243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "8015e00c9a71452681cf87ea7f0ec4b3"
format_stamp: "Formatted at 2026-08-07 10:42:46 on dist-test-slave-42z9"
server_key: "2b9dfacf0d36a37489fa2716ac3170fe"
server_key_iv: "9cf0d1b50ce891f1d6a481cf24e14569"
server_key_version: "encryptionkey@0"
I20260807 10:42:47.022151 13243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:47.036504 13243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:47.042341 13243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:47.042689 13243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:47.045989 13243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:47.046097 13243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:47.046229 13243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:47.046303 13243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:42:47 dist-test-slave-42z9 krb5kdc[13077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099366, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:47.073220 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:47.046564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:54229 (local address 127.11.46.190:36587)
0807 10:42:47.047405 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:47.047412 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:47.048568 (+ 1156us) server_negotiation.cc:407] Connection header received
0807 10:42:47.051120 (+ 2552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:47.051127 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:47.051237 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:47.051366 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:47.054596 (+ 3230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.055569 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.059253 (+ 3684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.059827 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.060004 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:47.065158 (+ 5154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:47.065164 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:47.065167 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:47.065209 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:47.068756 (+ 3547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:47.070035 (+ 1279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:47.070040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:47.070043 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:47.070262 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:47.071057 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:47.071063 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:47.071065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:47.071382 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:47.071515 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:47.072716 (+ 1201us) server_negotiation.cc:299] Negotiation successful
0807 10:42:47.072932 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":692,"thread_start_us":560,"threads_started":1}
I20260807 10:42:47.075287 13282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:47.047365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36587 (local address 127.11.46.129:54229)
0807 10:42:47.048336 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:47.048393 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:47.050765 (+ 2372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:47.051759 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:47.051774 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:47.052881 (+ 1107us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:47.054240 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:47.054283 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.055817 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.055832 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:47.058883 (+ 3051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:47.058922 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.060189 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.060199 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:47.060598 (+ 399us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:47.061575 (+ 977us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:47.061615 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:47.064840 (+ 3225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:47.068969 (+ 4129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:47.068984 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:47.069009 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:47.069869 (+ 860us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:47.070446 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:47.070458 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:47.070465 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:47.070870 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:47.071542 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:47.071554 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:47.072192 (+ 638us) client_negotiation.cc:769] Sending connection context
0807 10:42:47.072561 (+ 369us) client_negotiation.cc:240] Negotiation successful
0807 10:42:47.073293 (+ 732us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":394,"threads_started":1}
I20260807 10:42:47.100020 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:47.082516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:43911 (local address 127.11.46.190:36587)
0807 10:42:47.082781 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:47.082789 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:47.083699 (+ 910us) server_negotiation.cc:407] Connection header received
0807 10:42:47.084032 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:47.084038 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:47.084145 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:47.084251 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:47.085633 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.086652 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.089338 (+ 2686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.089916 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.090038 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:47.092990 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:47.092997 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:47.093001 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:47.093041 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:47.096561 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:47.097569 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:47.097576 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:47.097580 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:47.097744 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:47.098283 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:47.098290 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:47.098294 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:47.098636 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:47.098793 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:47.099370 (+ 577us) server_negotiation.cc:299] Negotiation successful
0807 10:42:47.099637 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:42:47.100158 13403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:47.082583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36587 (local address 127.11.46.129:43911)
0807 10:42:47.083534 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:47.083562 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:47.083776 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:47.084330 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:47.084340 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:47.084906 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:47.085356 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:47.085376 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.086885 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.086892 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:47.089122 (+ 2230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:47.089150 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.090193 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.090202 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:47.090433 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:47.091299 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:47.091332 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:47.092630 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:47.096827 (+ 4197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:47.096834 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:47.096838 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:47.097393 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:47.097905 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:47.097909 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:47.097912 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:47.098099 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:47.098769 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:47.098774 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:47.099056 (+ 282us) client_negotiation.cc:769] Sending connection context
0807 10:42:47.099212 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 10:42:47.099638 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":422,"threads_started":1}
I20260807 10:42:47.100824 13243 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:45047
I20260807 10:42:47.100869 13457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:45047 every 8 connection(s)
I20260807 10:42:47.102280 13243 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:42:47.103753 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 13243
I20260807 10:42:47.104030 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:42:47.104880 11450 external_mini_cluster.cc:1428] Setting key 01b7d0e5271c895ea3d00d3c861b5ad4
I20260807 10:42:47.106055 13458 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36587
I20260807 10:42:47.106353 13458 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:47.107350 13458 heartbeater.cc:511] Master 127.11.46.190:36587 requested a full tablet report, sending...
I20260807 10:42:47.109907 13144 ts_manager.cc:194] Registered new tserver with Master: 8015e00c9a71452681cf87ea7f0ec4b3 (127.11.46.129:45047)
I20260807 10:42:47.111600 13144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:54229
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:42:47.161509 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36587
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:36693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:47.548614 13463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:47.548961 13463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:47.549080 13463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:47.556825 13463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:47.556964 13463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:47.557058 13463 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:42:47.557144 13463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:42:47.567703 13463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:36693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.46.190:36587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:47.569188 13463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:47.570693 13463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:47.587145 13475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:47.587324 13481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:47.587406 13478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:47.588481 13463 server_base.cc:1034] running on GCE node
I20260807 10:42:47.589210 13463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:47.590536 13463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:47.591990 13463 hybrid_clock.cc:648] HybridClock initialized: now 1786099367591881 us; error 82 us; skew 500 ppm
I20260807 10:42:47.592397 13463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:47 dist-test-slave-42z9 krb5kdc[13077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099367, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:47.596158 13463 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:42:47.598043 13463 webserver.cc:460] Webserver started at http://127.11.46.130:44677/ using document root <none> and password file <none>
I20260807 10:42:47.598955 13463 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:47.599064 13463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:47.599457 13463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:47.603129 13463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "a2414985fac144238faeb556157fb6b2"
format_stamp: "Formatted at 2026-08-07 10:42:47 on dist-test-slave-42z9"
server_key: "0a38c3aff4239f91efd0ccaa22968978"
server_key_iv: "69bd3b41171ad52052addee83603da62"
server_key_version: "encryptionkey@0"
I20260807 10:42:47.604092 13463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "a2414985fac144238faeb556157fb6b2"
format_stamp: "Formatted at 2026-08-07 10:42:47 on dist-test-slave-42z9"
server_key: "0a38c3aff4239f91efd0ccaa22968978"
server_key_iv: "69bd3b41171ad52052addee83603da62"
server_key_version: "encryptionkey@0"
I20260807 10:42:47.610711 13463 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:42:47.615037 13490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:47.616752 13463 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:42:47.616955 13463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "a2414985fac144238faeb556157fb6b2"
format_stamp: "Formatted at 2026-08-07 10:42:47 on dist-test-slave-42z9"
server_key: "0a38c3aff4239f91efd0ccaa22968978"
server_key_iv: "69bd3b41171ad52052addee83603da62"
server_key_version: "encryptionkey@0"
I20260807 10:42:47.617219 13463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:47.643749 13463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:47.649709 13463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:47.650018 13463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:47.653505 13463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:47.653628 13463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 10:42:47.653772 13463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:47.653833 13463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:42:47 dist-test-slave-42z9 krb5kdc[13077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099367, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:47.682195 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:47.654138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:56789 (local address 127.11.46.190:36587)
0807 10:42:47.654873 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:47.654879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:47.656377 (+ 1498us) server_negotiation.cc:407] Connection header received
0807 10:42:47.659595 (+ 3218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:47.659603 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:47.659724 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:47.659825 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:47.663579 (+ 3754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.664572 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.668019 (+ 3447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.668493 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.668646 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:47.674381 (+ 5735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:47.674390 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:47.674394 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:47.674452 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:47.677800 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:47.679146 (+ 1346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:47.679153 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:47.679157 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:47.679351 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:47.679919 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:47.679925 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:47.679929 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:47.680332 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:47.680509 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:47.681429 (+ 920us) server_negotiation.cc:299] Negotiation successful
0807 10:42:47.681755 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":464,"threads_started":1}
I20260807 10:42:47.683424 13503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:47.654989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36587 (local address 127.11.46.130:56789)
0807 10:42:47.656113 (+ 1124us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:47.656178 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:47.659074 (+ 2896us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:47.660630 (+ 1556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:47.660653 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:47.661836 (+ 1183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:47.663182 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:47.663239 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.664786 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.664794 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:47.667710 (+ 2916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:47.667739 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.668840 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.668848 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:47.669260 (+ 412us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:47.670274 (+ 1014us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:47.670324 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:47.674008 (+ 3684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:47.678013 (+ 4005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:47.678026 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:47.678048 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:47.678894 (+ 846us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:47.679486 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:47.679491 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:47.679493 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:47.679767 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:47.680498 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:47.680509 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:47.680990 (+ 481us) client_negotiation.cc:769] Sending connection context
0807 10:42:47.681281 (+ 291us) client_negotiation.cc:240] Negotiation successful
0807 10:42:47.682015 (+ 734us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"thread_start_us":361,"threads_started":1}
I20260807 10:42:47.706964 13678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:37767 every 8 connection(s)
I20260807 10:42:47.706995 13463 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:37767
I20260807 10:42:47.709188 13624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:47.691160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36587 (local address 127.11.46.130:37511)
0807 10:42:47.691873 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:47.691896 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:47.692102 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:47.692445 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:47.692451 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:47.693169 (+ 718us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:47.693700 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:47.693721 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.695238 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.695244 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:47.697142 (+ 1898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:47.697175 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.698837 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.698844 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:47.699081 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:47.699894 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:47.699925 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:47.701492 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:47.706024 (+ 4532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:47.706029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:47.706032 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:47.706530 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:47.707071 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:47.707077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:47.707081 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:47.707271 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:47.708047 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:47.708052 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:47.708256 (+ 204us) client_negotiation.cc:769] Sending connection context
0807 10:42:47.708421 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 10:42:47.708760 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":369,"threads_started":1}
I20260807 10:42:47.709324 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:47.691242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:37511 (local address 127.11.46.190:36587)
0807 10:42:47.691493 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:47.691502 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:47.692005 (+ 503us) server_negotiation.cc:407] Connection header received
0807 10:42:47.692227 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:47.692230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:47.692305 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:47.692392 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:47.694076 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.695041 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.697474 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:47.698294 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:47.698452 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:47.701838 (+ 3386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:47.701847 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:47.701852 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:47.701906 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:47.705842 (+ 3936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:47.706683 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:47.706689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:47.706693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:47.706893 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:47.707402 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:47.707408 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:47.707411 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:47.707904 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:47.708118 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:47.708661 (+ 543us) server_negotiation.cc:299] Negotiation successful
0807 10:42:47.708961 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 10:42:47.709358 13463 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:42:47.711846 13680 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36587
I20260807 10:42:47.712736 13680 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:47.713579 13680 heartbeater.cc:511] Master 127.11.46.190:36587 requested a full tablet report, sending...
I20260807 10:42:47.715198 13144 ts_manager.cc:194] Registered new tserver with Master: a2414985fac144238faeb556157fb6b2 (127.11.46.130:37767)
I20260807 10:42:47.716063 13144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:56789
I20260807 10:42:47.718886 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 13463
I20260807 10:42:47.719087 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:42:47.719534 11450 external_mini_cluster.cc:1428] Setting key 2012e985de09b5bbc5fae68008bca352
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:42:47.773309 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36587
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:36693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:42:48.115226 13458 heartbeater.cc:503] Master 127.11.46.190:36587 was elected leader, sending a full tablet report...
W20260807 10:42:48.157629 13688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:48.157963 13688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:48.158118 13688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:48.165938 13688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:48.166095 13688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:48.166205 13688 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:42:48.166333 13688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:42:48.177181 13688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:36693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.46.190:36587
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:48.178778 13688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:48.180384 13688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:48.195900 13698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:48.195957 13697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:48.195861 13703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:48.196877 13688 server_base.cc:1034] running on GCE node
I20260807 10:42:48.197664 13688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:48.198836 13688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:48.200136 13688 hybrid_clock.cc:648] HybridClock initialized: now 1786099368200051 us; error 53 us; skew 500 ppm
I20260807 10:42:48.200508 13688 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:48 dist-test-slave-42z9 krb5kdc[13077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099368, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:48.204252 13688 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:42:48.206048 13688 webserver.cc:460] Webserver started at http://127.11.46.131:39689/ using document root <none> and password file <none>
I20260807 10:42:48.206857 13688 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:48.206990 13688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:48.207376 13688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:48.211242 13688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "63a54bd861b24cd0a21c8d024832a051"
format_stamp: "Formatted at 2026-08-07 10:42:48 on dist-test-slave-42z9"
server_key: "f3f2fc46080eccd478acf0e90e8c5f39"
server_key_iv: "583e0c527adb7f605971cd94a48f31fa"
server_key_version: "encryptionkey@0"
I20260807 10:42:48.212186 13688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "63a54bd861b24cd0a21c8d024832a051"
format_stamp: "Formatted at 2026-08-07 10:42:48 on dist-test-slave-42z9"
server_key: "f3f2fc46080eccd478acf0e90e8c5f39"
server_key_iv: "583e0c527adb7f605971cd94a48f31fa"
server_key_version: "encryptionkey@0"
I20260807 10:42:48.218550 13688 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260807 10:42:48.222945 13714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:48.224470 13688 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:42:48.224655 13688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "63a54bd861b24cd0a21c8d024832a051"
format_stamp: "Formatted at 2026-08-07 10:42:48 on dist-test-slave-42z9"
server_key: "f3f2fc46080eccd478acf0e90e8c5f39"
server_key_iv: "583e0c527adb7f605971cd94a48f31fa"
server_key_version: "encryptionkey@0"
I20260807 10:42:48.224892 13688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:48.246193 13688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:48.251451 13688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:48.251760 13688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:48.255076 13688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:48.255198 13688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:48.255357 13688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:48.255436 13688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:42:48 dist-test-slave-42z9 krb5kdc[13077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099368, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:48.282124 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.255622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:49821 (local address 127.11.46.190:36587)
0807 10:42:48.256487 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:48.256491 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:48.257553 (+ 1062us) server_negotiation.cc:407] Connection header received
0807 10:42:48.259888 (+ 2335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:48.259894 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:48.260005 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:48.260144 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:48.262763 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.263780 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.266523 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.267091 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.267225 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.272887 (+ 5662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:48.272897 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:48.272901 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:48.272966 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:48.277083 (+ 4117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:48.278367 (+ 1284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:48.278375 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:48.278380 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:48.278619 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:48.279585 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:48.279592 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:48.279596 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:48.280066 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:48.280291 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:48.281269 (+ 978us) server_negotiation.cc:299] Negotiation successful
0807 10:42:48.281621 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":646,"threads_started":1}
I20260807 10:42:48.282945 13727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.256414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36587 (local address 127.11.46.131:49821)
0807 10:42:48.257325 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:48.257398 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:48.259467 (+ 2069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:48.260536 (+ 1069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:48.260553 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:48.261413 (+ 860us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:48.262501 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.262529 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.263997 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.264002 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.266333 (+ 2331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.266359 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.267427 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.267435 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.267686 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.268590 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:48.268634 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:48.272486 (+ 3852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:48.277314 (+ 4828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:48.277328 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:48.277354 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:48.278186 (+ 832us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:48.278784 (+ 598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:48.278794 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:48.278798 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:48.279390 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:48.280291 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:48.280302 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:48.280810 (+ 508us) client_negotiation.cc:769] Sending connection context
0807 10:42:48.281085 (+ 275us) client_negotiation.cc:240] Negotiation successful
0807 10:42:48.281628 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":390,"threads_started":1}
I20260807 10:42:48.301904 13688 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:40739
I20260807 10:42:48.301923 13892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:40739 every 8 connection(s)
I20260807 10:42:48.303485 13688 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:42:48.306177 13894 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36587
I20260807 10:42:48.306452 13894 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:48.307253 13894 heartbeater.cc:511] Master 127.11.46.190:36587 requested a full tablet report, sending...
I20260807 10:42:48.308655 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.292557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:53309 (local address 127.11.46.190:36587)
0807 10:42:48.292795 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:48.292803 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:48.293278 (+ 475us) server_negotiation.cc:407] Connection header received
0807 10:42:48.293568 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:48.293575 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:48.293677 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:48.293804 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:48.294883 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.296057 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.298317 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.299216 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.299388 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.302293 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:48.302299 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:48.302303 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:48.302344 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:48.305675 (+ 3331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:48.306466 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:48.306471 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:48.306473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:48.306642 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:48.307067 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:48.307073 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:48.307077 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:48.307391 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:48.307568 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:48.308003 (+ 435us) server_negotiation.cc:299] Negotiation successful
0807 10:42:48.308252 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 10:42:48.308739 13859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.292406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36587 (local address 127.11.46.131:53309)
0807 10:42:48.293145 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:48.293167 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:48.293360 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:48.293877 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:48.293883 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:48.294386 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:48.294719 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.294731 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.296221 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.296231 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.298121 (+ 1890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.298147 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.299694 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.299701 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.299879 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.300643 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:48.300672 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:48.302015 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:48.305825 (+ 3810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:48.305831 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:48.305836 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:48.306325 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:48.306770 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:48.306776 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:48.306780 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:48.306941 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:48.307511 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:48.307516 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:48.307723 (+ 207us) client_negotiation.cc:769] Sending connection context
0807 10:42:48.307847 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 10:42:48.308253 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":353,"threads_started":1}
I20260807 10:42:48.308866 13144 ts_manager.cc:194] Registered new tserver with Master: 63a54bd861b24cd0a21c8d024832a051 (127.11.46.131:40739)
I20260807 10:42:48.309854 13144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:49821
I20260807 10:42:48.310952 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 13688
I20260807 10:42:48.311141 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:42:48.311736 11450 external_mini_cluster.cc:1428] Setting key d9d8d66c2224e6fe5286dac324a67513
I20260807 10:42:48.315084 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:42:48 dist-test-slave-42z9 krb5kdc[13077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099368, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 10:42:48 dist-test-slave-42z9 krb5kdc[13077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099368, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:48.382177 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.364880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47456 (local address 127.11.46.190:36587)
0807 10:42:48.365173 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:48.365180 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:48.365422 (+ 242us) server_negotiation.cc:407] Connection header received
0807 10:42:48.365642 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:48.365647 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:48.365758 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:48.365854 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:48.367414 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.368202 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.369575 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.370005 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.370116 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.375114 (+ 4998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:48.375121 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:48.375124 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:48.375176 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:48.378098 (+ 2922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:48.379016 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:48.379020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:48.379022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:48.379179 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:48.379759 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:48.379768 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:48.379770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:48.380316 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:48.380645 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:48.381175 (+ 530us) server_negotiation.cc:299] Negotiation successful
0807 10:42:48.381589 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260807 10:42:48.388123 13143 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:42:48.395766 13143 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:42:48.422668 13917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.409891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:40739 (local address 127.0.0.1:42604)
0807 10:42:48.411122 (+ 1231us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:48.411178 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:48.411402 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:48.412842 (+ 1440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:48.412850 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:48.412893 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:48.413411 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.413427 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.415873 (+ 2446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.415881 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.418714 (+ 2833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.418744 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.421232 (+ 2488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.421239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.421588 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.421664 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 10:42:48.421802 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 10:42:48.422175 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":895,"mutex_wait_us":1,"thread_start_us":1167,"threads_started":1}
I20260807 10:42:48.423882 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.410346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42604 (local address 127.11.46.131:40739)
0807 10:42:48.412130 (+ 1784us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:48.412137 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:48.412167 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:42:48.412269 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:48.412277 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:48.412598 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:48.412819 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:48.413721 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.415667 (+ 1946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.419069 (+ 3402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.420879 (+ 1810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.421050 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.421369 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:48.423286 (+ 1917us) server_negotiation.cc:299] Negotiation successful
0807 10:42:48.423523 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1621,"thread_start_us":1426,"threads_started":1}
I20260807 10:42:48.428582 13790 tablet_service.cc:1467] Processing CreateTablet for tablet 5a99e626649b47f4ba21df0fa7d2f2b7 (DEFAULT_TABLE table=test-table [id=0e61d9277eb3413d8d03e6870e1b9c3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:48.430223 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.410226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45047 (local address 127.0.0.1:59800)
0807 10:42:48.413651 (+ 3425us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:48.413678 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:48.413789 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:48.420893 (+ 7104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:48.420898 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:48.420929 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:48.421499 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.421515 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.425077 (+ 3562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.425082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.427427 (+ 2345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.427447 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.429282 (+ 1835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.429290 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.429539 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.429578 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 10:42:48.429671 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 10:42:48.429822 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3286,"thread_start_us":3115,"threads_started":1}
I20260807 10:42:48.430332 13921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.410844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59800 (local address 127.11.46.129:45047)
0807 10:42:48.420119 (+ 9275us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:48.420129 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:48.420165 (+ 36us) server_negotiation.cc:407] Connection header received
0807 10:42:48.420290 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:48.420299 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:48.420639 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:48.421757 (+ 1118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:48.422029 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.423873 (+ 1844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.427668 (+ 3795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.428930 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.429178 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.429426 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:48.429819 (+ 393us) server_negotiation.cc:299] Negotiation successful
0807 10:42:48.430015 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9077,"thread_start_us":8926,"threads_started":1}
I20260807 10:42:48.430927 13790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a99e626649b47f4ba21df0fa7d2f2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:48.434665 13348 tablet_service.cc:1467] Processing CreateTablet for tablet 5a99e626649b47f4ba21df0fa7d2f2b7 (DEFAULT_TABLE table=test-table [id=0e61d9277eb3413d8d03e6870e1b9c3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:48.436316 13348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a99e626649b47f4ba21df0fa7d2f2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:48.436640 13922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.413899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:37767 (local address 127.0.0.1:34804)
0807 10:42:48.420539 (+ 6640us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:48.420569 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:48.420709 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:48.428804 (+ 8095us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:48.428810 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:48.428847 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:48.429400 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.429419 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.431272 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.431277 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.433827 (+ 2550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.433846 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.435747 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.435754 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.435951 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.436002 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 10:42:48.436104 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 10:42:48.436270 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6472,"thread_start_us":6906,"threads_started":1}
I20260807 10:42:48.436744 13923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.414211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34804 (local address 127.11.46.130:37767)
0807 10:42:48.428079 (+ 13868us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:48.428087 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:48.428121 (+ 34us) server_negotiation.cc:407] Connection header received
0807 10:42:48.428249 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:48.428257 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:48.428542 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:48.428786 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:48.429655 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.431113 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.434014 (+ 2901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.435453 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.435631 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.435853 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:48.436221 (+ 368us) server_negotiation.cc:299] Negotiation successful
0807 10:42:48.436421 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13684,"thread_start_us":13525,"threads_started":1}
I20260807 10:42:48.441350 13566 tablet_service.cc:1467] Processing CreateTablet for tablet 5a99e626649b47f4ba21df0fa7d2f2b7 (DEFAULT_TABLE table=test-table [id=0e61d9277eb3413d8d03e6870e1b9c3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:48.443185 13566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5a99e626649b47f4ba21df0fa7d2f2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:48.449393 13926 tablet_bootstrap.cc:492] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: Bootstrap starting.
I20260807 10:42:48.451896 13927 tablet_bootstrap.cc:492] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: Bootstrap starting.
I20260807 10:42:48.454911 13926 tablet_bootstrap.cc:654] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:48.455479 13927 tablet_bootstrap.cc:654] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:48.456459 13926 log.cc:824] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:48.456552 13927 log.cc:824] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:48.459903 13931 tablet_bootstrap.cc:492] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: Bootstrap starting.
I20260807 10:42:48.460182 13926 tablet_bootstrap.cc:492] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: No bootstrap required, opened a new log
I20260807 10:42:48.460240 13927 tablet_bootstrap.cc:492] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: No bootstrap required, opened a new log
I20260807 10:42:48.460539 13926 ts_tablet_manager.cc:1397] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260807 10:42:48.460539 13927 ts_tablet_manager.cc:1397] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260807 10:42:48.463725 13931 tablet_bootstrap.cc:654] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:48.464910 13931 log.cc:824] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:48.468000 13931 tablet_bootstrap.cc:492] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: No bootstrap required, opened a new log
I20260807 10:42:48.468329 13931 ts_tablet_manager.cc:1397] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 10:42:48.472241 13926 raft_consensus.cc:348] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } }
I20260807 10:42:48.472235 13927 raft_consensus.cc:348] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } }
I20260807 10:42:48.472787 13927 raft_consensus.cc:374] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:48.472973 13926 raft_consensus.cc:374] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:48.472949 13927 raft_consensus.cc:729] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a54bd861b24cd0a21c8d024832a051, State: Initialized, Role: FOLLOWER
I20260807 10:42:48.473165 13926 raft_consensus.cc:729] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8015e00c9a71452681cf87ea7f0ec4b3, State: Initialized, Role: FOLLOWER
I20260807 10:42:48.473891 13927 consensus_queue.cc:260] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } }
I20260807 10:42:48.473881 13926 consensus_queue.cc:260] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } }
I20260807 10:42:48.475275 13894 heartbeater.cc:503] Master 127.11.46.190:36587 was elected leader, sending a full tablet report...
I20260807 10:42:48.476282 13927 ts_tablet_manager.cc:1428] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: Time spent starting tablet: real 0.016s user 0.010s sys 0.004s
I20260807 10:42:48.476478 13926 ts_tablet_manager.cc:1428] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: Time spent starting tablet: real 0.016s user 0.011s sys 0.003s
I20260807 10:42:48.479792 13931 raft_consensus.cc:348] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } }
I20260807 10:42:48.480455 13931 raft_consensus.cc:374] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:48.480592 13931 raft_consensus.cc:729] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2414985fac144238faeb556157fb6b2, State: Initialized, Role: FOLLOWER
I20260807 10:42:48.481508 13931 consensus_queue.cc:260] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } }
I20260807 10:42:48.482939 13680 heartbeater.cc:503] Master 127.11.46.190:36587 was elected leader, sending a full tablet report...
I20260807 10:42:48.483794 13931 ts_tablet_manager.cc:1428] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: Time spent starting tablet: real 0.015s user 0.007s sys 0.007s
I20260807 10:42:48.514417 13934 raft_consensus.cc:482] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:42:48.514807 13934 raft_consensus.cc:504] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } }
I20260807 10:42:48.516881 13934 leader_election.cc:288] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8015e00c9a71452681cf87ea7f0ec4b3 (127.11.46.129:45047), a2414985fac144238faeb556157fb6b2 (127.11.46.130:37767)
I20260807 10:42:48.524501 13727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.517666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45047 (local address 127.11.46.131:38745)
0807 10:42:48.517962 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:48.517986 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:48.518148 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:48.518735 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:48.518741 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:48.518777 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:48.519023 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.519037 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.520324 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.520328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.522270 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.522289 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.523865 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.523870 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.524036 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.524065 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 10:42:48.524146 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 10:42:48.524260 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"mutex_wait_us":23}
I20260807 10:42:48.524609 13921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.517727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:38745 (local address 127.11.46.129:45047)
0807 10:42:48.517962 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:48.517968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:48.518063 (+ 95us) server_negotiation.cc:407] Connection header received
0807 10:42:48.518340 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:48.518345 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:48.518428 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:48.518521 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:48.519189 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.520161 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.522457 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.523695 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.523893 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.523980 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:48.524196 (+ 216us) server_negotiation.cc:299] Negotiation successful
0807 10:42:48.524346 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:42:48.525539 13923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.518372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:42915 (local address 127.11.46.130:37767)
0807 10:42:48.518623 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:48.518630 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:48.519118 (+ 488us) server_negotiation.cc:407] Connection header received
0807 10:42:48.519281 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:48.519287 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:48.519387 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:48.519496 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:48.519971 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.520782 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.523233 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.524439 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.524621 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.524700 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:48.525055 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 10:42:48.525207 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:42:48.525642 13938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.518173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:37767 (local address 127.11.46.131:42915)
0807 10:42:48.519002 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:48.519021 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:48.519156 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:48.519500 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:48.519503 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:48.519523 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:48.519810 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.519819 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.520934 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.520940 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.523008 (+ 2068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.523026 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.524688 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.524694 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.524866 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.524903 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:42:48.524997 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 10:42:48.525144 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"mutex_wait_us":1,"thread_start_us":440,"threads_started":1}
I20260807 10:42:48.526239 13384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a99e626649b47f4ba21df0fa7d2f2b7" candidate_uuid: "63a54bd861b24cd0a21c8d024832a051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" is_pre_election: true
I20260807 10:42:48.526759 13598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a99e626649b47f4ba21df0fa7d2f2b7" candidate_uuid: "63a54bd861b24cd0a21c8d024832a051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2414985fac144238faeb556157fb6b2" is_pre_election: true
I20260807 10:42:48.526878 13384 raft_consensus.cc:2454] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63a54bd861b24cd0a21c8d024832a051 in term 0.
I20260807 10:42:48.527290 13598 raft_consensus.cc:2454] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63a54bd861b24cd0a21c8d024832a051 in term 0.
I20260807 10:42:48.527649 13716 leader_election.cc:302] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a54bd861b24cd0a21c8d024832a051, 8015e00c9a71452681cf87ea7f0ec4b3; no voters:
I20260807 10:42:48.528159 13934 raft_consensus.cc:2781] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:42:48.528316 13934 raft_consensus.cc:482] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:42:48.528440 13934 raft_consensus.cc:3037] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:48.531149 13934 raft_consensus.cc:504] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } }
I20260807 10:42:48.531860 13934 leader_election.cc:288] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [CANDIDATE]: Term 1 election: Requested vote from peers 8015e00c9a71452681cf87ea7f0ec4b3 (127.11.46.129:45047), a2414985fac144238faeb556157fb6b2 (127.11.46.130:37767)
I20260807 10:42:48.532539 13384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a99e626649b47f4ba21df0fa7d2f2b7" candidate_uuid: "63a54bd861b24cd0a21c8d024832a051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8015e00c9a71452681cf87ea7f0ec4b3"
I20260807 10:42:48.532784 13384 raft_consensus.cc:3037] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:48.532987 13598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a99e626649b47f4ba21df0fa7d2f2b7" candidate_uuid: "63a54bd861b24cd0a21c8d024832a051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2414985fac144238faeb556157fb6b2"
I20260807 10:42:48.533507 13598 raft_consensus.cc:3037] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:48.535470 13384 raft_consensus.cc:2454] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a54bd861b24cd0a21c8d024832a051 in term 1.
I20260807 10:42:48.536067 13716 leader_election.cc:302] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a54bd861b24cd0a21c8d024832a051, 8015e00c9a71452681cf87ea7f0ec4b3; no voters:
I20260807 10:42:48.536438 13934 raft_consensus.cc:2781] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:48.536851 13598 raft_consensus.cc:2454] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a54bd861b24cd0a21c8d024832a051 in term 1.
I20260807 10:42:48.537019 13934 raft_consensus.cc:686] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 1 LEADER]: Becoming Leader. State: Replica: 63a54bd861b24cd0a21c8d024832a051, State: Running, Role: LEADER
I20260807 10:42:48.537679 13934 consensus_queue.cc:237] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } }
I20260807 10:42:48.543305 13144 catalog_manager.cc:5495] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63a54bd861b24cd0a21c8d024832a051 (127.11.46.131). New cstate: current_term: 1 leader_uuid: "63a54bd861b24cd0a21c8d024832a051" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } health_report { overall_health: UNKNOWN } } }
W20260807 10:42:48.555608 13895 tablet.cc:2369] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:42:48.571475 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.565194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42612 (local address 127.11.46.131:40739)
0807 10:42:48.565500 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:48.565507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:48.565651 (+ 144us) server_negotiation.cc:407] Connection header received
0807 10:42:48.565959 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:48.565965 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:48.566075 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:48.566210 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:48.566638 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.567389 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.568901 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.569351 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.569535 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.570175 (+ 640us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:48.570808 (+ 633us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:48.570931 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:48.571070 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 10:42:48.571155 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:42:48.580765 13384 raft_consensus.cc:1261] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3 [term 1 FOLLOWER]: Refusing update from remote peer 63a54bd861b24cd0a21c8d024832a051: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:48.580904 13598 raft_consensus.cc:1261] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2 [term 1 FOLLOWER]: Refusing update from remote peer 63a54bd861b24cd0a21c8d024832a051: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:48.581838 13939 consensus_queue.cc:1035] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:48.582239 13934 consensus_queue.cc:1035] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:48.620270 13143 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:48.620716 13143 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:48.625874 13143 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83: Sending DeleteTablet for 3 replicas of tablet 5a99e626649b47f4ba21df0fa7d2f2b7
I20260807 10:42:48.627465 13348 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a99e626649b47f4ba21df0fa7d2f2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:48 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:59800
I20260807 10:42:48.627456 13790 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a99e626649b47f4ba21df0fa7d2f2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:48 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:42604
I20260807 10:42:48.627744 13566 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a99e626649b47f4ba21df0fa7d2f2b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:48 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:34804
I20260807 10:42:48.636664 13143 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47456:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:42:48.638585 13143 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:42:48.638716 13954 tablet_replica.cc:330] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: stopping tablet replica
I20260807 10:42:48.639564 13954 raft_consensus.cc:2229] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:48.640319 13954 raft_consensus.cc:2258] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:48.642968 13954 ts_tablet_manager.cc:1905] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:48.648720 13956 tablet_replica.cc:330] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: stopping tablet replica
I20260807 10:42:48.649482 13956 raft_consensus.cc:2229] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:48.650175 13956 raft_consensus.cc:2258] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:48.651495 13348 tablet_service.cc:1467] Processing CreateTablet for tablet 9ce324349e1f4571bec866dc4f876e4d (DEFAULT_TABLE table=test-table [id=5ece03662680475b858fee9fe07130cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:48.651723 13788 tablet_service.cc:1467] Processing CreateTablet for tablet 9ce324349e1f4571bec866dc4f876e4d (DEFAULT_TABLE table=test-table [id=5ece03662680475b858fee9fe07130cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:48.652113 13348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ce324349e1f4571bec866dc4f876e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:48.652365 13788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ce324349e1f4571bec866dc4f876e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:48.660637 13955 tablet_replica.cc:330] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: stopping tablet replica
I20260807 10:42:48.661791 13926 tablet_bootstrap.cc:492] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: Bootstrap starting.
I20260807 10:42:48.658392 13566 tablet_service.cc:1467] Processing CreateTablet for tablet 9ce324349e1f4571bec866dc4f876e4d (DEFAULT_TABLE table=test-table [id=5ece03662680475b858fee9fe07130cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:48.663725 13926 tablet_bootstrap.cc:654] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:48.664482 13566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ce324349e1f4571bec866dc4f876e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:48.661360 13955 raft_consensus.cc:2229] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:42:48.668974 13954 ts_tablet_manager.cc:1918] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:42:48.669210 13954 log.cc:1196] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/5a99e626649b47f4ba21df0fa7d2f2b7
I20260807 10:42:48.670173 13954 ts_tablet_manager.cc:1939] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 8015e00c9a71452681cf87ea7f0ec4b3: Deleting consensus metadata
I20260807 10:42:48.670246 13955 raft_consensus.cc:2258] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:48.672533 13123 catalog_manager.cc:4841] TS 8015e00c9a71452681cf87ea7f0ec4b3 (127.11.46.129:45047): tablet 5a99e626649b47f4ba21df0fa7d2f2b7 (table test-table [id=0e61d9277eb3413d8d03e6870e1b9c3a]) successfully deleted
I20260807 10:42:48.674018 13927 tablet_bootstrap.cc:492] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051: Bootstrap starting.
I20260807 10:42:48.674513 13955 ts_tablet_manager.cc:1905] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:48.676262 13927 tablet_bootstrap.cc:654] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:48.678758 13926 tablet_bootstrap.cc:492] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: No bootstrap required, opened a new log
I20260807 10:42:48.678978 13926 ts_tablet_manager.cc:1397] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.004s
I20260807 10:42:48.679983 13926 raft_consensus.cc:348] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.680262 13926 raft_consensus.cc:374] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:48.680357 13926 raft_consensus.cc:729] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8015e00c9a71452681cf87ea7f0ec4b3, State: Initialized, Role: FOLLOWER
I20260807 10:42:48.680730 13926 consensus_queue.cc:260] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.681569 13931 tablet_bootstrap.cc:492] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: Bootstrap starting.
I20260807 10:42:48.682753 13926 ts_tablet_manager.cc:1428] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260807 10:42:48.683676 13931 tablet_bootstrap.cc:654] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:48.689960 13955 ts_tablet_manager.cc:1918] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:42:48.690119 13956 ts_tablet_manager.cc:1905] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:48.690228 13955 log.cc:1196] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/5a99e626649b47f4ba21df0fa7d2f2b7
I20260807 10:42:48.690874 13955 ts_tablet_manager.cc:1939] T 5a99e626649b47f4ba21df0fa7d2f2b7 P 63a54bd861b24cd0a21c8d024832a051: Deleting consensus metadata
I20260807 10:42:48.693873 13126 catalog_manager.cc:4841] TS 63a54bd861b24cd0a21c8d024832a051 (127.11.46.131:40739): tablet 5a99e626649b47f4ba21df0fa7d2f2b7 (table test-table [id=0e61d9277eb3413d8d03e6870e1b9c3a]) successfully deleted
I20260807 10:42:48.697896 13956 ts_tablet_manager.cc:1918] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:42:48.698071 13956 log.cc:1196] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/5a99e626649b47f4ba21df0fa7d2f2b7
I20260807 10:42:48.698616 13956 ts_tablet_manager.cc:1939] T 5a99e626649b47f4ba21df0fa7d2f2b7 P a2414985fac144238faeb556157fb6b2: Deleting consensus metadata
I20260807 10:42:48.701591 13123 catalog_manager.cc:4841] TS a2414985fac144238faeb556157fb6b2 (127.11.46.130:37767): tablet 5a99e626649b47f4ba21df0fa7d2f2b7 (table test-table [id=0e61d9277eb3413d8d03e6870e1b9c3a]) successfully deleted
I20260807 10:42:48.705972 13927 tablet_bootstrap.cc:492] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051: No bootstrap required, opened a new log
I20260807 10:42:48.706218 13927 ts_tablet_manager.cc:1397] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.006s
I20260807 10:42:48.707257 13927 raft_consensus.cc:348] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.707520 13927 raft_consensus.cc:374] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:48.707621 13927 raft_consensus.cc:729] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a54bd861b24cd0a21c8d024832a051, State: Initialized, Role: FOLLOWER
I20260807 10:42:48.707983 13927 consensus_queue.cc:260] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.712795 13927 ts_tablet_manager.cc:1428] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260807 10:42:48.717059 13931 tablet_bootstrap.cc:492] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: No bootstrap required, opened a new log
I20260807 10:42:48.717268 13931 ts_tablet_manager.cc:1397] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.026s
I20260807 10:42:48.718183 13931 raft_consensus.cc:348] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.718415 13931 raft_consensus.cc:374] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:48.718493 13931 raft_consensus.cc:729] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2414985fac144238faeb556157fb6b2, State: Initialized, Role: FOLLOWER
I20260807 10:42:48.718725 13931 consensus_queue.cc:260] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.721418 13931 ts_tablet_manager.cc:1428] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260807 10:42:48.797477 13934 raft_consensus.cc:482] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:42:48.797757 13934 raft_consensus.cc:504] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.798659 13934 leader_election.cc:288] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8015e00c9a71452681cf87ea7f0ec4b3 (127.11.46.129:45047), a2414985fac144238faeb556157fb6b2 (127.11.46.130:37767)
I20260807 10:42:48.799449 13384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ce324349e1f4571bec866dc4f876e4d" candidate_uuid: "63a54bd861b24cd0a21c8d024832a051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" is_pre_election: true
I20260807 10:42:48.799471 13598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ce324349e1f4571bec866dc4f876e4d" candidate_uuid: "63a54bd861b24cd0a21c8d024832a051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2414985fac144238faeb556157fb6b2" is_pre_election: true
I20260807 10:42:48.799752 13598 raft_consensus.cc:2454] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63a54bd861b24cd0a21c8d024832a051 in term 0.
I20260807 10:42:48.799751 13384 raft_consensus.cc:2454] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63a54bd861b24cd0a21c8d024832a051 in term 0.
I20260807 10:42:48.800330 13716 leader_election.cc:302] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a54bd861b24cd0a21c8d024832a051, a2414985fac144238faeb556157fb6b2; no voters:
I20260807 10:42:48.800638 13934 raft_consensus.cc:2781] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:42:48.800787 13934 raft_consensus.cc:482] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:42:48.800885 13934 raft_consensus.cc:3037] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:48.804384 13934 raft_consensus.cc:504] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.805826 13384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ce324349e1f4571bec866dc4f876e4d" candidate_uuid: "63a54bd861b24cd0a21c8d024832a051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8015e00c9a71452681cf87ea7f0ec4b3"
I20260807 10:42:48.806110 13384 raft_consensus.cc:3037] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:48.809418 13384 raft_consensus.cc:2454] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a54bd861b24cd0a21c8d024832a051 in term 1.
I20260807 10:42:48.809821 13934 leader_election.cc:288] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [CANDIDATE]: Term 1 election: Requested vote from peers 8015e00c9a71452681cf87ea7f0ec4b3 (127.11.46.129:45047), a2414985fac144238faeb556157fb6b2 (127.11.46.130:37767)
I20260807 10:42:48.810168 13716 leader_election.cc:302] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63a54bd861b24cd0a21c8d024832a051, 8015e00c9a71452681cf87ea7f0ec4b3; no voters:
I20260807 10:42:48.810145 13598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ce324349e1f4571bec866dc4f876e4d" candidate_uuid: "63a54bd861b24cd0a21c8d024832a051" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2414985fac144238faeb556157fb6b2"
I20260807 10:42:48.810372 13598 raft_consensus.cc:3037] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:48.810501 13934 raft_consensus.cc:2781] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:48.810674 13934 raft_consensus.cc:686] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 1 LEADER]: Becoming Leader. State: Replica: 63a54bd861b24cd0a21c8d024832a051, State: Running, Role: LEADER
I20260807 10:42:48.810999 13934 consensus_queue.cc:237] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.813108 13598 raft_consensus.cc:2454] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63a54bd861b24cd0a21c8d024832a051 in term 1.
I20260807 10:42:48.814196 13143 catalog_manager.cc:5495] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63a54bd861b24cd0a21c8d024832a051 (127.11.46.131). New cstate: current_term: 1 leader_uuid: "63a54bd861b24cd0a21c8d024832a051" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } health_report { overall_health: HEALTHY } } }
W20260807 10:42:48.857681 13459 tablet.cc:2369] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 10:42:48 dist-test-slave-42z9 krb5kdc[13077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099366, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:48.888310 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.872441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47458 (local address 127.11.46.190:36587)
0807 10:42:48.872661 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:48.872667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:48.873519 (+ 852us) server_negotiation.cc:407] Connection header received
0807 10:42:48.873732 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:48.873738 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:48.873825 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:48.873942 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:48.875595 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.876412 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.878345 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.878785 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.878942 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.882681 (+ 3739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:48.882687 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:48.882690 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:48.882722 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:48.885343 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:48.886184 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:48.886188 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:48.886191 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:48.886361 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:48.886713 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:48.886718 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:48.886720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:48.887020 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:48.887222 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:48.887635 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 10:42:48.887963 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":107,"server-negotiator.queue_time_us":85}
I20260807 10:42:48.888314 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:48.872571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36587 (local address 127.0.0.1:47458)
0807 10:42:48.873349 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:48.873371 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:48.873586 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:48.874009 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:48.874013 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:48.875033 (+ 1020us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:48.875382 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.875395 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.876566 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.876572 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.878162 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:48.878180 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:48.879020 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:48.879027 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:48.879191 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:48.879898 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:48.879918 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:48.882473 (+ 2555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:48.885543 (+ 3070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:48.885559 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:48.885568 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:48.886062 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:48.886466 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:48.886471 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:48.886475 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:48.886605 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:48.887161 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:48.887169 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:48.887359 (+ 190us) client_negotiation.cc:769] Sending connection context
0807 10:42:48.887510 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 10:42:48.887817 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":417,"threads_started":1}
I20260807 10:42:48.894084 13143 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:47458:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 10:42:48.895293 13143 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:42:48.902997 13348 tablet_service.cc:1467] Processing CreateTablet for tablet e182b361489c450f9301a7c96da3d59b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a65ac958a3ea4fc38309f7bc61b9cedc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:42:48.903185 13566 tablet_service.cc:1467] Processing CreateTablet for tablet e182b361489c450f9301a7c96da3d59b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a65ac958a3ea4fc38309f7bc61b9cedc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:42:48.903697 13348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e182b361489c450f9301a7c96da3d59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:48.903815 13566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e182b361489c450f9301a7c96da3d59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:48.910153 13788 tablet_service.cc:1467] Processing CreateTablet for tablet e182b361489c450f9301a7c96da3d59b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a65ac958a3ea4fc38309f7bc61b9cedc]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:42:48.910552 13931 tablet_bootstrap.cc:492] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: Bootstrap starting.
I20260807 10:42:48.910830 13788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e182b361489c450f9301a7c96da3d59b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:48.912070 13931 tablet_bootstrap.cc:654] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:48.914471 13931 tablet_bootstrap.cc:492] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: No bootstrap required, opened a new log
I20260807 10:42:48.914642 13931 ts_tablet_manager.cc:1397] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260807 10:42:48.915257 13931 raft_consensus.cc:348] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.915462 13931 raft_consensus.cc:374] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:48.915512 13931 raft_consensus.cc:729] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2414985fac144238faeb556157fb6b2, State: Initialized, Role: FOLLOWER
I20260807 10:42:48.915759 13931 consensus_queue.cc:260] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.916335 13931 ts_tablet_manager.cc:1428] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 10:42:48.916261 13937 tablet_replica.cc:439] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } }
I20260807 10:42:48.916658 13937 tablet_replica.cc:442] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:48.919003 13927 tablet_bootstrap.cc:492] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: Bootstrap starting.
I20260807 10:42:48.920043 13926 tablet_bootstrap.cc:492] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: Bootstrap starting.
I20260807 10:42:48.920920 13927 tablet_bootstrap.cc:654] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:48.921887 13926 tablet_bootstrap.cc:654] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:48.932201 13927 tablet_bootstrap.cc:492] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: No bootstrap required, opened a new log
I20260807 10:42:48.932178 13926 tablet_bootstrap.cc:492] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: No bootstrap required, opened a new log
I20260807 10:42:48.932410 13926 ts_tablet_manager.cc:1397] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260807 10:42:48.932430 13927 ts_tablet_manager.cc:1397] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20260807 10:42:48.933303 13927 raft_consensus.cc:348] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.933290 13926 raft_consensus.cc:348] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.933615 13926 raft_consensus.cc:374] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:48.933626 13927 raft_consensus.cc:374] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:48.933708 13926 raft_consensus.cc:729] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8015e00c9a71452681cf87ea7f0ec4b3, State: Initialized, Role: FOLLOWER
I20260807 10:42:48.933714 13927 raft_consensus.cc:729] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63a54bd861b24cd0a21c8d024832a051, State: Initialized, Role: FOLLOWER
I20260807 10:42:48.933995 13926 consensus_queue.cc:260] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.933995 13927 consensus_queue.cc:260] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:48.934685 13926 ts_tablet_manager.cc:1428] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:42:48.934526 13933 tablet_replica.cc:439] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } }
I20260807 10:42:48.934955 13933 tablet_replica.cc:442] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:48.935599 13927 ts_tablet_manager.cc:1428] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 10:42:48.935367 13934 tablet_replica.cc:439] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } }
I20260807 10:42:48.935768 13934 tablet_replica.cc:442] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 10:42:48.962427 13681 tablet.cc:2369] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:42:49.039778 13937 raft_consensus.cc:482] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:42:49.040097 13937 raft_consensus.cc:504] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:49.042037 13937 leader_election.cc:288] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8015e00c9a71452681cf87ea7f0ec4b3 (127.11.46.129:45047), 63a54bd861b24cd0a21c8d024832a051 (127.11.46.131:40739)
I20260807 10:42:49.060864 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.043027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:47369 (local address 127.11.46.131:40739)
0807 10:42:49.043235 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:49.043242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:49.053318 (+ 10076us) server_negotiation.cc:407] Connection header received
0807 10:42:49.053703 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:49.053710 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:49.053829 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:49.053905 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:49.054978 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.056103 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.058213 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.059631 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.059830 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.059920 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:49.060320 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 10:42:49.060485 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 10:42:49.061209 13976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.042386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45047 (local address 127.11.46.130:50959)
0807 10:42:49.052802 (+ 10416us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:49.052844 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:49.053100 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:49.054111 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:49.054116 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:49.054143 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:49.054504 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:49.054517 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.056051 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.056057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:49.058294 (+ 2237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:49.058313 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.060116 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.060121 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:49.060406 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.060443 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:42:49.060638 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 10:42:49.060786 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10215,"mutex_wait_us":58,"thread_start_us":10812,"threads_started":1}
I20260807 10:42:49.061311 13974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.042509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:40739 (local address 127.11.46.130:47369)
0807 10:42:49.053175 (+ 10666us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:49.053198 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:49.053487 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:49.054176 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:49.054181 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:49.054232 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:49.054788 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:49.054804 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.056247 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.056251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:49.058011 (+ 1760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:49.058029 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.059846 (+ 1817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.059853 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:49.060073 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.060122 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 10:42:49.060249 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 10:42:49.060461 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10529,"mutex_wait_us":29,"thread_start_us":9899,"threads_started":1}
I20260807 10:42:49.062026 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.042508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:50959 (local address 127.11.46.129:45047)
0807 10:42:49.053806 (+ 11298us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:49.053811 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:49.053828 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:42:49.053892 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:49.053895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:49.053952 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:49.054054 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:49.054711 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.055866 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.058507 (+ 2641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.059750 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.059937 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.060019 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:49.061421 (+ 1402us) server_negotiation.cc:299] Negotiation successful
0807 10:42:49.061704 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11191,"thread_start_us":11085,"threads_started":1}
I20260807 10:42:49.062520 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e182b361489c450f9301a7c96da3d59b" candidate_uuid: "a2414985fac144238faeb556157fb6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a54bd861b24cd0a21c8d024832a051" is_pre_election: true
I20260807 10:42:49.062671 13384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e182b361489c450f9301a7c96da3d59b" candidate_uuid: "a2414985fac144238faeb556157fb6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" is_pre_election: true
I20260807 10:42:49.062986 13384 raft_consensus.cc:2454] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2414985fac144238faeb556157fb6b2 in term 0.
I20260807 10:42:49.063040 13818 raft_consensus.cc:2454] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2414985fac144238faeb556157fb6b2 in term 0.
I20260807 10:42:49.063860 13491 leader_election.cc:302] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 63a54bd861b24cd0a21c8d024832a051, 8015e00c9a71452681cf87ea7f0ec4b3, a2414985fac144238faeb556157fb6b2; no voters:
I20260807 10:42:49.064395 13937 raft_consensus.cc:2781] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:42:49.064549 13937 raft_consensus.cc:482] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:42:49.064659 13937 raft_consensus.cc:3037] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:49.067284 13937 raft_consensus.cc:504] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:49.068049 13937 leader_election.cc:288] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [CANDIDATE]: Term 1 election: Requested vote from peers 8015e00c9a71452681cf87ea7f0ec4b3 (127.11.46.129:45047), 63a54bd861b24cd0a21c8d024832a051 (127.11.46.131:40739)
I20260807 10:42:49.068662 13384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e182b361489c450f9301a7c96da3d59b" candidate_uuid: "a2414985fac144238faeb556157fb6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8015e00c9a71452681cf87ea7f0ec4b3"
I20260807 10:42:49.068759 13818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e182b361489c450f9301a7c96da3d59b" candidate_uuid: "a2414985fac144238faeb556157fb6b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63a54bd861b24cd0a21c8d024832a051"
I20260807 10:42:49.068948 13384 raft_consensus.cc:3037] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:49.068984 13818 raft_consensus.cc:3037] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:49.072173 13384 raft_consensus.cc:2454] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2414985fac144238faeb556157fb6b2 in term 1.
I20260807 10:42:49.072294 13818 raft_consensus.cc:2454] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2414985fac144238faeb556157fb6b2 in term 1.
I20260807 10:42:49.072829 13491 leader_election.cc:302] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 63a54bd861b24cd0a21c8d024832a051, 8015e00c9a71452681cf87ea7f0ec4b3, a2414985fac144238faeb556157fb6b2; no voters:
I20260807 10:42:49.073251 13937 raft_consensus.cc:2781] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:49.073817 13937 raft_consensus.cc:686] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [term 1 LEADER]: Becoming Leader. State: Replica: a2414985fac144238faeb556157fb6b2, State: Running, Role: LEADER
I20260807 10:42:49.074278 13937 consensus_queue.cc:237] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } }
I20260807 10:42:49.076565 13980 tablet_replica.cc:439] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: TxnStatusTablet state changed. Reason: New leader a2414985fac144238faeb556157fb6b2. Latest consensus state: current_term: 1 leader_uuid: "a2414985fac144238faeb556157fb6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } }
I20260807 10:42:49.077101 13980 tablet_replica.cc:442] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:42:49.079032 13987 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 10:42:49.078898 13140 catalog_manager.cc:5495] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2414985fac144238faeb556157fb6b2 (127.11.46.130). New cstate: current_term: 1 leader_uuid: "a2414985fac144238faeb556157fb6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } health_report { overall_health: UNKNOWN } } }
I20260807 10:42:49.079413 13987 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 10:42:49.138856 13969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.120879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:37767 (local address 127.0.0.1:34820)
0807 10:42:49.121185 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:49.121209 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:49.121385 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:49.131399 (+ 10014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:49.131405 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:49.131425 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:42:49.131683 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:49.131695 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.133534 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.133541 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:49.135242 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:49.135265 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.136478 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.136485 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:49.136700 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.136802 (+ 102us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:42:49.138177 (+ 1375us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:42:49.138218 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 10:42:49.138321 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 10:42:49.138511 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 10:42:49.138881 13994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.121634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34820 (local address 127.11.46.130:37767)
0807 10:42:49.130492 (+ 8858us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:49.130499 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:49.130535 (+ 36us) server_negotiation.cc:407] Connection header received
0807 10:42:49.130704 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:49.130710 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:49.130882 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:49.131165 (+ 283us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:49.131879 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.133309 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.135466 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.136243 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.136412 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.137078 (+ 666us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:49.138037 (+ 959us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:49.138191 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:49.138369 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 10:42:49.138472 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8638,"thread_start_us":8437,"threads_started":1}
I20260807 10:42:49.146190 13384 raft_consensus.cc:1261] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3 [term 1 FOLLOWER]: Refusing update from remote peer a2414985fac144238faeb556157fb6b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:49.146276 13818 raft_consensus.cc:1261] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051 [term 1 FOLLOWER]: Refusing update from remote peer a2414985fac144238faeb556157fb6b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:49.147203 13980 consensus_queue.cc:1035] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:49.147644 13937 consensus_queue.cc:1035] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:49.158454 13933 tablet_replica.cc:439] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: TxnStatusTablet state changed. Reason: New leader a2414985fac144238faeb556157fb6b2. Latest consensus state: current_term: 1 leader_uuid: "a2414985fac144238faeb556157fb6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } }
I20260807 10:42:49.158808 13933 tablet_replica.cc:442] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:49.160642 13995 mvcc.cc:205] Tried to move back new op lower bound from 7315863016013111296 to 7315863015732101120. Current Snapshot: MvccSnapshot[applied={T|T < 7315863016013111296}]
I20260807 10:42:49.162547 13996 mvcc.cc:205] Tried to move back new op lower bound from 7315863016013111296 to 7315863015732101120. Current Snapshot: MvccSnapshot[applied={T|T < 7315863016013111296}]
I20260807 10:42:49.163859 13980 tablet_replica.cc:439] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a2414985fac144238faeb556157fb6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } }
I20260807 10:42:49.165122 13980 tablet_replica.cc:442] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:42:49.184423 13933 tablet_replica.cc:439] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a2414985fac144238faeb556157fb6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } }
I20260807 10:42:49.184756 13933 tablet_replica.cc:442] T e182b361489c450f9301a7c96da3d59b P 8015e00c9a71452681cf87ea7f0ec4b3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:49.191401 13934 tablet_replica.cc:439] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: TxnStatusTablet state changed. Reason: New leader a2414985fac144238faeb556157fb6b2. Latest consensus state: current_term: 1 leader_uuid: "a2414985fac144238faeb556157fb6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } }
I20260807 10:42:49.191828 13934 tablet_replica.cc:442] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:49.193866 13980 tablet_replica.cc:439] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a2414985fac144238faeb556157fb6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } }
I20260807 10:42:49.194187 13980 tablet_replica.cc:442] T e182b361489c450f9301a7c96da3d59b P a2414985fac144238faeb556157fb6b2: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:42:49.197165 13997 mvcc.cc:205] Tried to move back new op lower bound from 7315863016013111296 to 7315863015732101120. Current Snapshot: MvccSnapshot[applied={T|T < 7315863016013111296}]
I20260807 10:42:49.199040 13934 tablet_replica.cc:439] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a2414985fac144238faeb556157fb6b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 } } peers { permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 } } peers { permanent_uuid: "63a54bd861b24cd0a21c8d024832a051" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40739 } } }
I20260807 10:42:49.199402 13934 tablet_replica.cc:442] T e182b361489c450f9301a7c96da3d59b P 63a54bd861b24cd0a21c8d024832a051: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:49.204928 13994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.197304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:47405 (local address 127.11.46.130:37767)
0807 10:42:49.197518 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:49.197524 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:49.198664 (+ 1140us) server_negotiation.cc:407] Connection header received
0807 10:42:49.198992 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:49.198998 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:49.199103 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:49.199171 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:49.200139 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.201355 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.203120 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.203559 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.203703 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.204203 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:49.204313 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:49.204396 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:49.204539 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 10:42:49.204624 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:42:49.205142 14010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.196882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:37767 (local address 127.11.46.131:47405)
0807 10:42:49.198537 (+ 1655us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:49.198559 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:49.198806 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:49.199546 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:49.199550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:49.199563 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:42:49.199933 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:49.199944 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.201513 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.201542 (+ 29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:49.202978 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:49.202994 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.203755 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.203763 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:49.203911 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.203999 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:42:49.204412 (+ 413us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:42:49.204426 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 10:42:49.204502 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 10:42:49.204659 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1422,"thread_start_us":1232,"threads_started":1}
I20260807 10:42:49.216086 13384 raft_consensus.cc:1261] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3 [term 1 FOLLOWER]: Refusing update from remote peer 63a54bd861b24cd0a21c8d024832a051: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:49.216037 13598 raft_consensus.cc:1261] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2 [term 1 FOLLOWER]: Refusing update from remote peer 63a54bd861b24cd0a21c8d024832a051: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:49.216807 13948 consensus_queue.cc:1035] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2414985fac144238faeb556157fb6b2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 37767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:49.217494 13934 consensus_queue.cc:1035] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8015e00c9a71452681cf87ea7f0ec4b3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:49.261612 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.253584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:52931 (local address 127.11.46.131:40739)
0807 10:42:49.253792 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:49.253799 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:49.254093 (+ 294us) server_negotiation.cc:407] Connection header received
0807 10:42:49.254467 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:49.254473 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:49.254584 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:49.254655 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:49.255718 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.256762 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.259111 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.259788 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.259905 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.260676 (+ 771us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:49.260829 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:49.260899 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:49.261157 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 10:42:49.261258 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:42:49.262869 14024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.253073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:40739 (local address 127.11.46.130:52931)
0807 10:42:49.253980 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:49.254002 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:49.254249 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:49.254945 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:49.254949 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:49.254967 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:42:49.255461 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:49.255481 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.256970 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.256976 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:49.258930 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:49.258948 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.260119 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.260126 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:49.260327 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.260409 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:42:49.260996 (+ 587us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:42:49.261011 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 10:42:49.262109 (+ 1098us) client_negotiation.cc:240] Negotiation successful
0807 10:42:49.262310 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":4469,"threads_started":1}
I20260807 10:42:49.335651 13140 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:49.335928 13140 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47456:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:49.339459 13140 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25ef902ab91f4c1c8270baf27c9b5b83: Sending DeleteTablet for 3 replicas of tablet 9ce324349e1f4571bec866dc4f876e4d
I20260807 10:42:49.340561 13788 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ce324349e1f4571bec866dc4f876e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:49 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:42604
I20260807 10:42:49.341379 14031 tablet_replica.cc:330] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051: stopping tablet replica
I20260807 10:42:49.341348 13348 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ce324349e1f4571bec866dc4f876e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:49 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:59800
I20260807 10:42:49.341759 14031 raft_consensus.cc:2229] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:42:49.342232 13566 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ce324349e1f4571bec866dc4f876e4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:49 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:34804
I20260807 10:42:49.342377 14031 raft_consensus.cc:2258] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:49.343763 14031 ts_tablet_manager.cc:1905] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:49.352353 14031 ts_tablet_manager.cc:1918] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:42:49.352662 14031 log.cc:1196] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/9ce324349e1f4571bec866dc4f876e4d
I20260807 10:42:49.353242 14031 ts_tablet_manager.cc:1939] T 9ce324349e1f4571bec866dc4f876e4d P 63a54bd861b24cd0a21c8d024832a051: Deleting consensus metadata
I20260807 10:42:49.354840 13126 catalog_manager.cc:4841] TS 63a54bd861b24cd0a21c8d024832a051 (127.11.46.131:40739): tablet 9ce324349e1f4571bec866dc4f876e4d (table test-table [id=5ece03662680475b858fee9fe07130cd]) successfully deleted
I20260807 10:42:49.366149 14035 tablet_replica.cc:330] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: stopping tablet replica
I20260807 10:42:49.366428 14035 raft_consensus.cc:2229] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:49.366868 14035 raft_consensus.cc:2258] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:49.367858 14033 tablet_replica.cc:330] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: stopping tablet replica
I20260807 10:42:49.368149 14033 raft_consensus.cc:2229] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:49.368605 14033 raft_consensus.cc:2258] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:49.369868 14035 ts_tablet_manager.cc:1905] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:49.369861 14033 ts_tablet_manager.cc:1905] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:49.378288 14033 ts_tablet_manager.cc:1918] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:42:49.378286 14035 ts_tablet_manager.cc:1918] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:42:49.378530 14035 log.cc:1196] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/9ce324349e1f4571bec866dc4f876e4d
I20260807 10:42:49.378597 14033 log.cc:1196] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/9ce324349e1f4571bec866dc4f876e4d
I20260807 10:42:49.379197 14035 ts_tablet_manager.cc:1939] T 9ce324349e1f4571bec866dc4f876e4d P a2414985fac144238faeb556157fb6b2: Deleting consensus metadata
I20260807 10:42:49.379199 14033 ts_tablet_manager.cc:1939] T 9ce324349e1f4571bec866dc4f876e4d P 8015e00c9a71452681cf87ea7f0ec4b3: Deleting consensus metadata
I20260807 10:42:49.380525 13123 catalog_manager.cc:4841] TS 8015e00c9a71452681cf87ea7f0ec4b3 (127.11.46.129:45047): tablet 9ce324349e1f4571bec866dc4f876e4d (table test-table [id=5ece03662680475b858fee9fe07130cd]) successfully deleted
I20260807 10:42:49.381071 13123 catalog_manager.cc:4841] TS a2414985fac144238faeb556157fb6b2 (127.11.46.130:37767): tablet 9ce324349e1f4571bec866dc4f876e4d (table test-table [id=5ece03662680475b858fee9fe07130cd]) successfully deleted
Aug 07 10:42:49 dist-test-slave-42z9 krb5kdc[13077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099368, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:42:49.395165 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.368500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59808 (local address 127.11.46.129:45047)
0807 10:42:49.368732 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:49.368738 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:49.378143 (+ 9405us) server_negotiation.cc:407] Connection header received
0807 10:42:49.378474 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:49.378481 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:49.378591 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:49.378671 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:49.380902 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.381888 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.383285 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.383743 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.383866 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.388673 (+ 4807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:49.388693 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:49.388714 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:49.388762 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:49.391882 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:49.392764 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:49.392774 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:49.392777 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:49.392953 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:49.393374 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:49.393379 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:49.393382 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:49.393861 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:49.394218 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:49.394531 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 10:42:49.394810 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 10:42:49.396015 13450 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59808
I20260807 10:42:49.417261 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.399399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47464 (local address 127.11.46.190:36587)
0807 10:42:49.402542 (+ 3143us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:49.402549 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:49.402575 (+ 26us) server_negotiation.cc:407] Connection header received
0807 10:42:49.402657 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:49.402662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:49.402784 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:49.402926 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:49.404457 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.405644 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.406975 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.407627 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.407782 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.411107 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:49.411113 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:49.411116 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:49.411161 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:49.414025 (+ 2864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:49.415062 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:49.415067 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:49.415069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:49.415228 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:49.415654 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:49.415657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:49.415660 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:49.415961 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:49.416154 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:49.416595 (+ 441us) server_negotiation.cc:299] Negotiation successful
0807 10:42:49.416869 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2989,"thread_start_us":2831,"threads_started":1}
W20260807 10:42:49.417900 13140 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47464
I20260807 10:42:49.420969 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 13243
I20260807 10:42:49.438498 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.422031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59810 (local address 127.11.46.129:45047)
0807 10:42:49.422280 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:49.422286 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:49.422516 (+ 230us) server_negotiation.cc:407] Connection header received
0807 10:42:49.422664 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:49.422670 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:49.422755 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:49.422863 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:49.424030 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.425156 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.426691 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.427425 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.427569 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.430348 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:49.430357 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:49.430363 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:49.430425 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:49.434908 (+ 4483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:49.435952 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:49.435960 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:49.435964 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:49.436196 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:49.436709 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:49.436715 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:49.436719 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:49.437151 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:49.437505 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:49.437819 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 10:42:49.438102 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
W20260807 10:42:49.439258 13450 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59810
W20260807 10:42:49.439946 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 13243: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:42:49.440156 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 13243
I20260807 10:42:49.471501 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 13463
Aug 07 10:42:49 dist-test-slave-42z9 krb5kdc[13077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099368, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:42:49.488818 13994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.472393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34828 (local address 127.11.46.130:37767)
0807 10:42:49.472641 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:49.472647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:49.472670 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:42:49.472779 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:49.472785 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:49.472886 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:49.473010 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:49.474318 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.475149 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.476480 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.476975 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.477099 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.481604 (+ 4505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:49.481619 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:49.481637 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:49.481690 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:49.485201 (+ 3511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:49.486367 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:49.486380 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:49.486382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:49.486570 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:49.487032 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:49.487038 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:49.487041 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:49.487520 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:49.487892 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:49.488169 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 10:42:49.488443 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
W20260807 10:42:49.489581 13667 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34828
W20260807 10:42:49.490293 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 13463: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:42:49.490489 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 13463
I20260807 10:42:49.527295 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 13688
Aug 07 10:42:49 dist-test-slave-42z9 krb5kdc[13077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099368, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:42:49.544238 13919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:49.528124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42622 (local address 127.11.46.131:40739)
0807 10:42:49.528357 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:49.528363 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:49.528386 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:42:49.528562 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:49.528566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:49.528656 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:49.528747 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:49.530193 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.530942 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.532261 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:49.532717 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:49.532841 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:49.537755 (+ 4914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:49.537777 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:49.537797 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:49.537843 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:49.540763 (+ 2920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:49.541654 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:49.541662 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:49.541665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:49.541833 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:49.542403 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:49.542411 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:49.542414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:49.543202 (+ 788us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:49.543545 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:49.543734 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 10:42:49.543961 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 10:42:49.545037 13888 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42622
W20260807 10:42:49.545693 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 13688: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:42:49.545848 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 13688
I20260807 10:42:49.579191 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 13100
I20260807 10:42:49.580482 13201 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:49.704347 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 13100
2026-08-07T10:42:49Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5315 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:42:49 dist-test-slave-42z9 krb5kdc[14050](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:42:49 dist-test-slave-42z9 krb5kdc[14050](info): set up 2 sockets
Aug 07 10:42:49 dist-test-slave-42z9 krb5kdc[14050](info): commencing operation
krb5kdc: starting...
W20260807 10:42:50.935961 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.001s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:42:51 dist-test-slave-42z9 krb5kdc[14050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:42:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:42:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:42:51.193363 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:38933
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:41661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:38933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:51.567072 14070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:51.567442 14070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:51.567544 14070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:51.575145 14070 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:42:51.575294 14070 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 10:42:51.575337 14070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:51.575424 14070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:51.575479 14070 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:42:51.575542 14070 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:42:51.586691 14070 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:41661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:38933
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:38933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:51.588164 14070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:51.589668 14070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:51.602577 14078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:51.602622 14082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:51.602617 14079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:51.604001 14070 server_base.cc:1034] running on GCE node
I20260807 10:42:51.604902 14070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:51.606669 14070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:51.607946 14070 hybrid_clock.cc:648] HybridClock initialized: now 1786099371607860 us; error 59 us; skew 500 ppm
I20260807 10:42:51.608332 14070 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:51 dist-test-slave-42z9 krb5kdc[14050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099371, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:51.611804 14070 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:42:51.613714 14070 webserver.cc:460] Webserver started at http://127.11.46.190:40163/ using document root <none> and password file <none>
I20260807 10:42:51.614543 14070 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:51.614647 14070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:51.614969 14070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:51.618526 14070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "e1c2b50c58c84c1ebfda617a21cc25d8"
format_stamp: "Formatted at 2026-08-07 10:42:51 on dist-test-slave-42z9"
server_key: "d24e86ee3e4b4e97d304416ce613b5e6"
server_key_iv: "3efe21ddfb2ee6ab4cbc98b17436a1c0"
server_key_version: "encryptionkey@0"
I20260807 10:42:51.619467 14070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "e1c2b50c58c84c1ebfda617a21cc25d8"
format_stamp: "Formatted at 2026-08-07 10:42:51 on dist-test-slave-42z9"
server_key: "d24e86ee3e4b4e97d304416ce613b5e6"
server_key_iv: "3efe21ddfb2ee6ab4cbc98b17436a1c0"
server_key_version: "encryptionkey@0"
I20260807 10:42:51.625782 14070 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260807 10:42:51.630024 14100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:51.631808 14070 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:42:51.632053 14070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "e1c2b50c58c84c1ebfda617a21cc25d8"
format_stamp: "Formatted at 2026-08-07 10:42:51 on dist-test-slave-42z9"
server_key: "d24e86ee3e4b4e97d304416ce613b5e6"
server_key_iv: "3efe21ddfb2ee6ab4cbc98b17436a1c0"
server_key_version: "encryptionkey@0"
I20260807 10:42:51.632297 14070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:51.650156 14070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:51.655877 14070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:51.656148 14070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:51.680100 14070 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:38933
I20260807 10:42:51.680140 14185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:38933 every 8 connection(s)
I20260807 10:42:51.681715 14070 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:42:51.686250 14187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:51.690435 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 14070
I20260807 10:42:51.690722 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:42:51.691641 11450 external_mini_cluster.cc:1428] Setting key f864acc4146164bdf92e6b46cc399fcc
I20260807 10:42:51.701479 14187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8: Bootstrap starting.
I20260807 10:42:51.705610 14187 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:51.707036 14187 log.cc:824] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8: Log is configured to *not* fsync() on all Append() calls
Aug 07 10:42:51 dist-test-slave-42z9 krb5kdc[14050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:51.711899 14187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8: No bootstrap required, opened a new log
I20260807 10:42:51.720826 14190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:51.694405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58410 (local address 127.11.46.190:38933)
0807 10:42:51.695378 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:51.695392 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:51.695444 (+ 52us) server_negotiation.cc:407] Connection header received
0807 10:42:51.697345 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:51.697381 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:51.698008 (+ 627us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:51.698518 (+ 510us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:51.700236 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:51.701807 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:51.703310 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:51.704147 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:51.704364 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:51.709615 (+ 5251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:51.709634 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:51.709670 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:51.709735 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:51.713836 (+ 4101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:51.715135 (+ 1299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:51.715149 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:51.715162 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:51.715559 (+ 397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:51.716304 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:51.716311 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:51.716314 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:51.717170 (+ 856us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:51.717567 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:51.718353 (+ 786us) server_negotiation.cc:299] Negotiation successful
0807 10:42:51.719155 (+ 802us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":421,"threads_started":1}
I20260807 10:42:51.722322 14187 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c2b50c58c84c1ebfda617a21cc25d8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38933 } }
I20260807 10:42:51.722875 14187 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:51.723002 14187 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c2b50c58c84c1ebfda617a21cc25d8, State: Initialized, Role: FOLLOWER
I20260807 10:42:51.723706 14187 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c2b50c58c84c1ebfda617a21cc25d8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38933 } }
I20260807 10:42:51.724012 14187 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:42:51.724159 14187 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:42:51.724371 14187 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:51.726963 14187 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c2b50c58c84c1ebfda617a21cc25d8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38933 } }
I20260807 10:42:51.727596 14187 leader_election.cc:302] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1c2b50c58c84c1ebfda617a21cc25d8; no voters:
I20260807 10:42:51.728233 14187 leader_election.cc:288] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:42:51.728399 14193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:51.729796 14193 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [term 1 LEADER]: Becoming Leader. State: Replica: e1c2b50c58c84c1ebfda617a21cc25d8, State: Running, Role: LEADER
I20260807 10:42:51.730366 14193 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c2b50c58c84c1ebfda617a21cc25d8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38933 } }
I20260807 10:42:51.730706 14187 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:42:51.733287 14198 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1c2b50c58c84c1ebfda617a21cc25d8. Latest consensus state: current_term: 1 leader_uuid: "e1c2b50c58c84c1ebfda617a21cc25d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c2b50c58c84c1ebfda617a21cc25d8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38933 } } }
I20260807 10:42:51.733768 14198 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:51.734274 14196 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1c2b50c58c84c1ebfda617a21cc25d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c2b50c58c84c1ebfda617a21cc25d8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38933 } } }
I20260807 10:42:51.734580 14196 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:42:51.734794 14209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:42:51.740736 14209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:42:51.751292 14209 catalog_manager.cc:1347] Generated new cluster ID: acfa23c61b4040958292fcdd8c1bc7db
I20260807 10:42:51.751425 14209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:42:51.770015 14209 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:42:51.771507 14209 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:42:51.781807 14209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8: Generated new TSK 0
I20260807 10:42:51.782823 14209 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:42:51.852768 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:38933
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:41661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:52.232205 14227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:52.232534 14227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:52.232667 14227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:52.240788 14227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:52.240931 14227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:52.241048 14227 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 10:42:52.241115 14227 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:42:52.241200 14227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:42:52.251717 14227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:41661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.46.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:52.253167 14227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:52.254691 14227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:52.269637 14232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:52.269681 14238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:52.269654 14236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:52.271275 14227 server_base.cc:1034] running on GCE node
I20260807 10:42:52.272063 14227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:52.273171 14227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:52.274451 14227 hybrid_clock.cc:648] HybridClock initialized: now 1786099372274388 us; error 52 us; skew 500 ppm
I20260807 10:42:52.274843 14227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:52 dist-test-slave-42z9 krb5kdc[14050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:52.281908 14227 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:42:52.283776 14227 webserver.cc:460] Webserver started at http://127.11.46.129:33551/ using document root <none> and password file <none>
I20260807 10:42:52.284762 14227 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:52.284937 14227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:52.285305 14227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:52.288761 14227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "7de3dda642db423189b4313bda42a045"
format_stamp: "Formatted at 2026-08-07 10:42:52 on dist-test-slave-42z9"
server_key: "a8b6955e12a1d90a604fbe9c9f1596d9"
server_key_iv: "20470ec18aa38f9183f8eed71d81d4cc"
server_key_version: "encryptionkey@0"
I20260807 10:42:52.289722 14227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "7de3dda642db423189b4313bda42a045"
format_stamp: "Formatted at 2026-08-07 10:42:52 on dist-test-slave-42z9"
server_key: "a8b6955e12a1d90a604fbe9c9f1596d9"
server_key_iv: "20470ec18aa38f9183f8eed71d81d4cc"
server_key_version: "encryptionkey@0"
I20260807 10:42:52.295679 14227 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:42:52.299924 14248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:52.301515 14227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:42:52.301713 14227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "7de3dda642db423189b4313bda42a045"
format_stamp: "Formatted at 2026-08-07 10:42:52 on dist-test-slave-42z9"
server_key: "a8b6955e12a1d90a604fbe9c9f1596d9"
server_key_iv: "20470ec18aa38f9183f8eed71d81d4cc"
server_key_version: "encryptionkey@0"
I20260807 10:42:52.301959 14227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:52.317940 14227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:52.322438 14227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:52.322758 14227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:52.325923 14227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:52.326049 14227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:52.326195 14227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:52.326337 14227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 07 10:42:52 dist-test-slave-42z9 krb5kdc[14050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:52.352156 14262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:52.327211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:38933 (local address 127.11.46.129:37269)
0807 10:42:52.328249 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:52.328319 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:52.330657 (+ 2338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:52.331581 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:52.331611 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:52.332572 (+ 961us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:52.333752 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:52.333795 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.335250 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.335256 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:52.337012 (+ 1756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:52.337036 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.338279 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.338286 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:52.338518 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:52.339254 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:52.339282 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:52.342465 (+ 3183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:52.346678 (+ 4213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:52.346690 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:52.346717 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:52.347559 (+ 842us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:52.348157 (+ 598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:52.348161 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:52.348163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:52.348403 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:52.349148 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:52.349159 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:52.349772 (+ 613us) client_negotiation.cc:769] Sending connection context
0807 10:42:52.350222 (+ 450us) client_negotiation.cc:240] Negotiation successful
0807 10:42:52.350840 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":412,"threads_started":1}
I20260807 10:42:52.353773 14260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:52.326457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:37269 (local address 127.11.46.190:38933)
0807 10:42:52.327344 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:52.327350 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:52.328493 (+ 1143us) server_negotiation.cc:407] Connection header received
0807 10:42:52.331019 (+ 2526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:52.331025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:52.331122 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:52.331223 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:52.334046 (+ 2823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.335058 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.337244 (+ 2186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.337999 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.338175 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:52.342822 (+ 4647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:52.342830 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:52.342835 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:52.342884 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:52.346483 (+ 3599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:52.347773 (+ 1290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:52.347780 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:52.347785 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:52.348006 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:52.348519 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:52.348525 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:52.348528 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:52.348962 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:52.349173 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:52.353090 (+ 3917us) server_negotiation.cc:299] Negotiation successful
0807 10:42:52.353350 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":743,"thread_start_us":606,"threads_started":1}
I20260807 10:42:52.376475 14260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:52.360776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:45001 (local address 127.11.46.190:38933)
0807 10:42:52.360976 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:52.360983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:52.361955 (+ 972us) server_negotiation.cc:407] Connection header received
0807 10:42:52.362173 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:52.362177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:52.362250 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:52.362334 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:52.363476 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.364207 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.365653 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.366189 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.366325 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:52.369238 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:52.369243 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:52.369246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:52.369285 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:52.372692 (+ 3407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:52.373858 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:52.373865 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:52.373869 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:52.374015 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:52.374545 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:52.374551 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:52.374553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:52.374975 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:52.375149 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:52.375832 (+ 683us) server_negotiation.cc:299] Negotiation successful
0807 10:42:52.376090 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:42:52.376631 14343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:52.360856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:38933 (local address 127.11.46.129:45001)
0807 10:42:52.361812 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:52.361833 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:52.362029 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:52.362386 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:52.362391 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:52.362963 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:52.363297 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:52.363309 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.364378 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.364382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:52.365499 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:52.365516 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.366614 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.366624 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:52.366909 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:52.367703 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:52.367724 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:52.368975 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:52.372879 (+ 3904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:52.372885 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:52.372889 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:52.373646 (+ 757us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:52.374170 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:52.374176 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:52.374184 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:52.374407 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:52.375216 (+ 809us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:52.375219 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:52.375471 (+ 252us) client_negotiation.cc:769] Sending connection context
0807 10:42:52.375697 (+ 226us) client_negotiation.cc:240] Negotiation successful
0807 10:42:52.376146 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":643,"threads_started":1}
I20260807 10:42:52.385414 14227 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:33215
I20260807 10:42:52.385495 14427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:33215 every 8 connection(s)
I20260807 10:42:52.386819 14227 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:42:52.389130 14428 heartbeater.cc:347] Connected to a master server at 127.11.46.190:38933
I20260807 10:42:52.389389 14428 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:52.390295 14428 heartbeater.cc:511] Master 127.11.46.190:38933 requested a full tablet report, sending...
I20260807 10:42:52.390549 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 14227
I20260807 10:42:52.390765 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:42:52.391572 11450 external_mini_cluster.cc:1428] Setting key 829cbf74388bf3204a6594b6b53fbcf3
I20260807 10:42:52.393029 14122 ts_manager.cc:194] Registered new tserver with Master: 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215)
I20260807 10:42:52.394742 14122 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:37269
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:42:52.446833 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:38933
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:41661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:42:52.828084 14438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:52.828436 14438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:52.828583 14438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:52.836565 14438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:52.836745 14438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:52.836894 14438 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 10:42:52.836966 14438 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:42:52.837082 14438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:42:52.847985 14438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:41661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.46.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:52.849620 14438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:52.851217 14438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:52.865984 14445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:52.866266 14444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:52.866303 14447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:52.867666 14438 server_base.cc:1034] running on GCE node
I20260807 10:42:52.868305 14438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:52.869319 14438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:52.870556 14438 hybrid_clock.cc:648] HybridClock initialized: now 1786099372870481 us; error 49 us; skew 500 ppm
I20260807 10:42:52.870893 14438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:52 dist-test-slave-42z9 krb5kdc[14050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:52.874233 14438 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:42:52.875909 14438 webserver.cc:460] Webserver started at http://127.11.46.130:41833/ using document root <none> and password file <none>
I20260807 10:42:52.876658 14438 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:52.876772 14438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:52.877115 14438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:52.880465 14438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "e47173c962324e9d89bc83f9b829af3b"
format_stamp: "Formatted at 2026-08-07 10:42:52 on dist-test-slave-42z9"
server_key: "e1e99d09fcc6f8f094fed157f9d7c362"
server_key_iv: "0bcb64edb4e06a25d9014d51d052e7ef"
server_key_version: "encryptionkey@0"
I20260807 10:42:52.881311 14438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "e47173c962324e9d89bc83f9b829af3b"
format_stamp: "Formatted at 2026-08-07 10:42:52 on dist-test-slave-42z9"
server_key: "e1e99d09fcc6f8f094fed157f9d7c362"
server_key_iv: "0bcb64edb4e06a25d9014d51d052e7ef"
server_key_version: "encryptionkey@0"
I20260807 10:42:52.887789 14438 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:42:52.892500 14456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:52.894410 14438 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260807 10:42:52.894683 14438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "e47173c962324e9d89bc83f9b829af3b"
format_stamp: "Formatted at 2026-08-07 10:42:52 on dist-test-slave-42z9"
server_key: "e1e99d09fcc6f8f094fed157f9d7c362"
server_key_iv: "0bcb64edb4e06a25d9014d51d052e7ef"
server_key_version: "encryptionkey@0"
I20260807 10:42:52.894973 14438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:52.923689 14438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:52.928488 14438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:52.928826 14438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:52.932173 14438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:52.932299 14438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:52.932425 14438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:52.932511 14438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:42:52 dist-test-slave-42z9 krb5kdc[14050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099372, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:52.960716 14473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:52.932921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:54221 (local address 127.11.46.190:38933)
0807 10:42:52.935625 (+ 2704us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:52.935632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:52.935658 (+ 26us) server_negotiation.cc:407] Connection header received
0807 10:42:52.937636 (+ 1978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:52.937642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:52.937744 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:52.937849 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:52.940597 (+ 2748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.941691 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.945230 (+ 3539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.945918 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.946104 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:52.952177 (+ 6073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:52.952188 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:52.952194 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:52.952259 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:52.955985 (+ 3726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:52.957533 (+ 1548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:52.957540 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:52.957552 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:52.957731 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:52.958442 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:52.958445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:52.958447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:52.958779 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:52.958917 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:52.960169 (+ 1252us) server_negotiation.cc:299] Negotiation successful
0807 10:42:52.960397 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2568,"thread_start_us":2440,"threads_started":1}
I20260807 10:42:52.962976 14476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:52.933621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:38933 (local address 127.11.46.130:54221)
0807 10:42:52.934787 (+ 1166us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:52.934855 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:52.937275 (+ 2420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:52.938218 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:52.938233 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:52.939185 (+ 952us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:52.940263 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:52.940306 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.941995 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.942004 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:52.944948 (+ 2944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:52.944981 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.946281 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.946291 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:52.946705 (+ 414us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:52.947662 (+ 957us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:52.947703 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:52.951693 (+ 3990us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:52.956216 (+ 4523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:52.956234 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:52.956264 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:52.957300 (+ 1036us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:52.957888 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:52.957895 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:52.957900 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:52.958311 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:52.958925 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:52.958937 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:52.959661 (+ 724us) client_negotiation.cc:769] Sending connection context
0807 10:42:52.960062 (+ 401us) client_negotiation.cc:240] Negotiation successful
0807 10:42:52.960815 (+ 753us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":451,"threads_started":1}
I20260807 10:42:52.983426 14438 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:35811
I20260807 10:42:52.983475 14628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:35811 every 8 connection(s)
I20260807 10:42:52.984954 14438 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:42:52.985237 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 14438
I20260807 10:42:52.985431 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:42:52.986006 14583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:52.969776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:38933 (local address 127.11.46.130:41339)
0807 10:42:52.970461 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:52.970482 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:52.970692 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:52.971160 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:52.971166 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:52.971842 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:52.972318 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:52.972336 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.973912 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.973922 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:52.975451 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:52.975474 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.976777 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.976783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:52.977000 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:52.977826 (+ 826us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:52.977868 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:52.979211 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:52.982920 (+ 3709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:52.982930 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:52.982934 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:52.983446 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:52.983933 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:52.983939 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:52.983944 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:52.984098 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:52.984764 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:52.984769 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:52.984992 (+ 223us) client_negotiation.cc:769] Sending connection context
0807 10:42:52.985141 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 10:42:52.985529 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":363,"threads_started":1}
I20260807 10:42:52.986075 11450 external_mini_cluster.cc:1428] Setting key cbc3b723d6ecd2dabed4fb7dd3fde948
I20260807 10:42:52.986176 14473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:52.969741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:41339 (local address 127.11.46.190:38933)
0807 10:42:52.969947 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:52.969954 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:52.970619 (+ 665us) server_negotiation.cc:407] Connection header received
0807 10:42:52.970884 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:52.970890 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:52.970989 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:52.971093 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:52.972549 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.973741 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.975631 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:52.976246 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:52.976388 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:52.979502 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:52.979508 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:52.979511 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:52.979551 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:52.982738 (+ 3187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:52.983645 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:52.983652 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:52.983656 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:52.983805 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:52.984214 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:52.984219 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:52.984223 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:52.984610 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:52.984760 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:52.985630 (+ 870us) server_negotiation.cc:299] Negotiation successful
0807 10:42:52.985885 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:42:52.990438 14629 heartbeater.cc:347] Connected to a master server at 127.11.46.190:38933
I20260807 10:42:52.990737 14629 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:52.991493 14629 heartbeater.cc:511] Master 127.11.46.190:38933 requested a full tablet report, sending...
I20260807 10:42:52.993115 14121 ts_manager.cc:194] Registered new tserver with Master: e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811)
I20260807 10:42:52.994415 14121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:54221
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:42:53.042913 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:38933
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:41661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:42:53.398643 14428 heartbeater.cc:503] Master 127.11.46.190:38933 was elected leader, sending a full tablet report...
W20260807 10:42:53.428922 14642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:42:53.429265 14642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:42:53.429423 14642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:42:53.437238 14642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:42:53.437412 14642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:42:53.437570 14642 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 10:42:53.437642 14642 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:42:53.437755 14642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:42:53.448684 14642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:41661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.46.190:38933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:42:53.450238 14642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:42:53.451774 14642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:42:53.466667 14647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:53.466732 14650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:42:53.466797 14648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:42:53.468122 14642 server_base.cc:1034] running on GCE node
I20260807 10:42:53.468866 14642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:42:53.470000 14642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:42:53.471238 14642 hybrid_clock.cc:648] HybridClock initialized: now 1786099373471178 us; error 49 us; skew 500 ppm
I20260807 10:42:53.471617 14642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:42:53 dist-test-slave-42z9 krb5kdc[14050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099373, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:42:53.475221 14642 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:42:53.476989 14642 webserver.cc:460] Webserver started at http://127.11.46.131:40627/ using document root <none> and password file <none>
I20260807 10:42:53.477859 14642 fs_manager.cc:359] Metadata directory not provided
I20260807 10:42:53.478010 14642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:42:53.478353 14642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:42:53.482028 14642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "e87ecd1b20424db49bf7e7b44ad9d697"
format_stamp: "Formatted at 2026-08-07 10:42:53 on dist-test-slave-42z9"
server_key: "cb89fb00737ffbb714da574b2dace9ca"
server_key_iv: "feb4f096ef4c746f957bd381acb6745f"
server_key_version: "encryptionkey@0"
I20260807 10:42:53.483008 14642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "e87ecd1b20424db49bf7e7b44ad9d697"
format_stamp: "Formatted at 2026-08-07 10:42:53 on dist-test-slave-42z9"
server_key: "cb89fb00737ffbb714da574b2dace9ca"
server_key_iv: "feb4f096ef4c746f957bd381acb6745f"
server_key_version: "encryptionkey@0"
I20260807 10:42:53.489636 14642 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:42:53.493916 14662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:53.495488 14642 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:42:53.495689 14642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "e87ecd1b20424db49bf7e7b44ad9d697"
format_stamp: "Formatted at 2026-08-07 10:42:53 on dist-test-slave-42z9"
server_key: "cb89fb00737ffbb714da574b2dace9ca"
server_key_iv: "feb4f096ef4c746f957bd381acb6745f"
server_key_version: "encryptionkey@0"
I20260807 10:42:53.495922 14642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:42:53.513226 14642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:42:53.518151 14642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:42:53.518461 14642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:42:53.521692 14642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:42:53.521836 14642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:42:53.521986 14642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:42:53.522086 14642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:42:53 dist-test-slave-42z9 krb5kdc[14050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099373, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:53.548290 14679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.523037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:38933 (local address 127.11.46.131:41145)
0807 10:42:53.523908 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:53.523956 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:53.525997 (+ 2041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:53.526846 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:53.526859 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:53.527677 (+ 818us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:53.528633 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.528659 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.530421 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.530426 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.532703 (+ 2277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.532720 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.533926 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.533935 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.534237 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.535114 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:53.535154 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:53.539073 (+ 3919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:53.543200 (+ 4127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:53.543213 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:53.543230 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:53.543787 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:53.544216 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:53.544222 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:53.544226 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:53.544469 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:53.545075 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:53.545084 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:53.545579 (+ 495us) client_negotiation.cc:769] Sending connection context
0807 10:42:53.545911 (+ 332us) client_negotiation.cc:240] Negotiation successful
0807 10:42:53.546555 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":366,"threads_started":1}
I20260807 10:42:53.549620 14677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.522254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:41145 (local address 127.11.46.190:38933)
0807 10:42:53.523157 (+ 903us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:53.523162 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:53.524087 (+ 925us) server_negotiation.cc:407] Connection header received
0807 10:42:53.526343 (+ 2256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:53.526348 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:53.526439 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:53.526551 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:53.528919 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.530198 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.532874 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.533614 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.533777 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.539464 (+ 5687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:53.539482 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:53.539487 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:53.539539 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:53.542996 (+ 3457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:53.543931 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:53.543937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:53.543940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:53.544083 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:53.544592 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:53.544596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:53.544598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:53.544901 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:53.545108 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:53.548925 (+ 3817us) server_negotiation.cc:299] Negotiation successful
0807 10:42:53.549224 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":798,"thread_start_us":662,"threads_started":1}
I20260807 10:42:53.580447 14677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.565113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:54785 (local address 127.11.46.190:38933)
0807 10:42:53.565342 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:53.565349 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:53.566230 (+ 881us) server_negotiation.cc:407] Connection header received
0807 10:42:53.566443 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:53.566447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:53.566541 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:53.566631 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:53.567736 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.568507 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.570394 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.570970 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.571106 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.573759 (+ 2653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:53.573765 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:53.573769 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:53.573810 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:53.576894 (+ 3084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:53.578218 (+ 1324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:53.578224 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:53.578228 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:53.578398 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:53.578815 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:53.578820 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:53.578824 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:53.579160 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:53.579333 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:53.579794 (+ 461us) server_negotiation.cc:299] Negotiation successful
0807 10:42:53.580054 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 10:42:53.580540 14775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.565154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:38933 (local address 127.11.46.131:54785)
0807 10:42:53.566106 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:53.566124 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:53.566297 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:53.566718 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:53.566722 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:53.567244 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:53.567569 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.567580 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.568847 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.568852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.570181 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.570212 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.571201 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.571208 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.571376 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.572122 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:53.572151 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:53.573493 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:53.577091 (+ 3598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:53.577099 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:53.577107 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:53.578018 (+ 911us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:53.578533 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:53.578537 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:53.578540 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:53.578688 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:53.579297 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:53.579302 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:53.579527 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 10:42:53.579657 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 10:42:53.580068 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"thread_start_us":434,"threads_started":1}
I20260807 10:42:53.594545 14642 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:44227
I20260807 10:42:53.594602 14848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:44227 every 8 connection(s)
I20260807 10:42:53.595984 14642 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:42:53.596659 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 14642
I20260807 10:42:53.596843 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:42:53.597517 11450 external_mini_cluster.cc:1428] Setting key e1a3d12a5955d19d3ef07d610786c3e0
I20260807 10:42:53.598572 14849 heartbeater.cc:347] Connected to a master server at 127.11.46.190:38933
I20260807 10:42:53.598855 14849 heartbeater.cc:464] Registering TS with master...
I20260807 10:42:53.599781 14849 heartbeater.cc:511] Master 127.11.46.190:38933 requested a full tablet report, sending...
I20260807 10:42:53.601356 14121 ts_manager.cc:194] Registered new tserver with Master: e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227)
I20260807 10:42:53.602265 14121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:41145
I20260807 10:42:53.613425 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:42:53 dist-test-slave-42z9 krb5kdc[14050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 10:42:53 dist-test-slave-42z9 krb5kdc[14050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:53.677434 14677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.662313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58412 (local address 127.11.46.190:38933)
0807 10:42:53.662556 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:53.662563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:53.662910 (+ 347us) server_negotiation.cc:407] Connection header received
0807 10:42:53.663117 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:53.663121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:53.663190 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:53.663281 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:53.664829 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.665700 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.667065 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.667498 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.667622 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.672000 (+ 4378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:53.672006 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:53.672009 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:53.672071 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:53.674614 (+ 2543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:53.675372 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:53.675376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:53.675379 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:53.675531 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:53.675927 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:53.675931 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:53.675933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:53.676241 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:53.676513 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:53.676837 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 10:42:53.677099 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260807 10:42:53.682494 14121 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58412:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:42:53.690466 14121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:42:53.718420 14870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.704545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33215 (local address 127.0.0.1:33456)
0807 10:42:53.705758 (+ 1213us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:53.705813 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:53.706047 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:53.708281 (+ 2234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:53.708290 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:53.708327 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:53.708871 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.708886 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.711438 (+ 2552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.711445 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.714292 (+ 2847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.714317 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.717073 (+ 2756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.717081 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.717396 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.717481 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 10:42:53.717664 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 10:42:53.717949 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"thread_start_us":2388,"threads_started":1}
I20260807 10:42:53.720039 14871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.704948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33456 (local address 127.11.46.129:33215)
0807 10:42:53.706722 (+ 1774us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:53.706734 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:53.706770 (+ 36us) server_negotiation.cc:407] Connection header received
0807 10:42:53.706884 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:53.706893 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:53.707724 (+ 831us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:53.707966 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:53.709117 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.711167 (+ 2050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.714577 (+ 3410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.716365 (+ 1788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.716556 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.716854 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:53.719431 (+ 2577us) server_negotiation.cc:299] Negotiation successful
0807 10:42:53.719687 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1573,"thread_start_us":1458,"threads_started":1}
I20260807 10:42:53.724980 14325 tablet_service.cc:1467] Processing CreateTablet for tablet 812be8dfd16f474faf9bd21793258346 (DEFAULT_TABLE table=test-table [id=9ef5f57fdbd24b89b4267c98b4bc6402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:53.726733 14873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.707375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:44227 (local address 127.0.0.1:56130)
0807 10:42:53.718178 (+ 10803us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:53.718200 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:53.718334 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:53.719899 (+ 1565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:53.719905 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:53.719935 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:53.720297 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.720309 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.722236 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.722242 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.724274 (+ 2032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.724293 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.725836 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.725842 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.726007 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.726045 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 10:42:53.726160 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 10:42:53.726314 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10642,"mutex_wait_us":34,"thread_start_us":11068,"threads_started":1}
I20260807 10:42:53.726768 14874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.708148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56130 (local address 127.11.46.131:44227)
0807 10:42:53.719275 (+ 11127us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:53.719283 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:53.719315 (+ 32us) server_negotiation.cc:407] Connection header received
0807 10:42:53.719428 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:53.719435 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:53.719680 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:53.719880 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:53.720555 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.722083 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.724481 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.725614 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.725758 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.726045 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:53.726219 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 10:42:53.726412 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10931,"thread_start_us":10747,"threads_started":1}
I20260807 10:42:53.727005 14325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 812be8dfd16f474faf9bd21793258346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:53.728238 14867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.704742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:35811 (local address 127.0.0.1:49024)
0807 10:42:53.707221 (+ 2479us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:53.707241 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:53.707361 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:53.720939 (+ 13578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:53.720944 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:53.720972 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:53.721290 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.721300 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.723171 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.723176 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.725376 (+ 2200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.725394 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.727330 (+ 1936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.727337 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.727568 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.727595 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 10:42:53.727683 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 10:42:53.727829 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2336,"mutex_wait_us":51,"thread_start_us":506,"threads_started":1}
I20260807 10:42:53.731411 14740 tablet_service.cc:1467] Processing CreateTablet for tablet 812be8dfd16f474faf9bd21793258346 (DEFAULT_TABLE table=test-table [id=9ef5f57fdbd24b89b4267c98b4bc6402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:53.732910 14740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 812be8dfd16f474faf9bd21793258346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:53.728237 14872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.705051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49024 (local address 127.11.46.130:35811)
0807 10:42:53.720291 (+ 15240us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:53.720300 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:53.720334 (+ 34us) server_negotiation.cc:407] Connection header received
0807 10:42:53.720458 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:53.720467 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:53.720726 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:53.720914 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:53.721525 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.722983 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.725634 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.727081 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.727240 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.727461 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:53.727756 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 10:42:53.727935 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15046,"thread_start_us":15410,"threads_started":1}
I20260807 10:42:53.740511 14876 tablet_bootstrap.cc:492] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: Bootstrap starting.
I20260807 10:42:53.741813 14530 tablet_service.cc:1467] Processing CreateTablet for tablet 812be8dfd16f474faf9bd21793258346 (DEFAULT_TABLE table=test-table [id=9ef5f57fdbd24b89b4267c98b4bc6402]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:53.743206 14530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 812be8dfd16f474faf9bd21793258346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:53.744796 14876 tablet_bootstrap.cc:654] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:53.746341 14876 log.cc:824] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:53.749553 14878 tablet_bootstrap.cc:492] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: Bootstrap starting.
I20260807 10:42:53.750605 14876 tablet_bootstrap.cc:492] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: No bootstrap required, opened a new log
I20260807 10:42:53.750919 14876 ts_tablet_manager.cc:1397] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260807 10:42:53.753614 14878 tablet_bootstrap.cc:654] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:53.755029 14878 log.cc:824] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:53.759006 14878 tablet_bootstrap.cc:492] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: No bootstrap required, opened a new log
I20260807 10:42:53.759420 14878 ts_tablet_manager.cc:1397] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20260807 10:42:53.759629 14876 raft_consensus.cc:348] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:53.760212 14880 tablet_bootstrap.cc:492] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: Bootstrap starting.
I20260807 10:42:53.760169 14876 raft_consensus.cc:374] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:53.760970 14876 raft_consensus.cc:729] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de3dda642db423189b4313bda42a045, State: Initialized, Role: FOLLOWER
I20260807 10:42:53.761718 14876 consensus_queue.cc:260] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:53.763674 14876 ts_tablet_manager.cc:1428] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: Time spent starting tablet: real 0.013s user 0.006s sys 0.006s
I20260807 10:42:53.764211 14880 tablet_bootstrap.cc:654] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:53.765666 14880 log.cc:824] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: Log is configured to *not* fsync() on all Append() calls
I20260807 10:42:53.768846 14878 raft_consensus.cc:348] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:53.769239 14880 tablet_bootstrap.cc:492] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: No bootstrap required, opened a new log
I20260807 10:42:53.769367 14878 raft_consensus.cc:374] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:53.769503 14878 raft_consensus.cc:729] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87ecd1b20424db49bf7e7b44ad9d697, State: Initialized, Role: FOLLOWER
I20260807 10:42:53.769572 14880 ts_tablet_manager.cc:1397] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260807 10:42:53.770205 14878 consensus_queue.cc:260] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:53.771370 14849 heartbeater.cc:503] Master 127.11.46.190:38933 was elected leader, sending a full tablet report...
I20260807 10:42:53.772109 14878 ts_tablet_manager.cc:1428] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260807 10:42:53.778475 14880 raft_consensus.cc:348] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:53.778888 14880 raft_consensus.cc:374] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:53.778963 14880 raft_consensus.cc:729] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47173c962324e9d89bc83f9b829af3b, State: Initialized, Role: FOLLOWER
I20260807 10:42:53.779564 14880 consensus_queue.cc:260] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:53.780606 14629 heartbeater.cc:503] Master 127.11.46.190:38933 was elected leader, sending a full tablet report...
I20260807 10:42:53.781085 14880 ts_tablet_manager.cc:1428] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
W20260807 10:42:53.848061 14850 tablet.cc:2369] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:42:53.889765 14429 tablet.cc:2369] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:42:53.938031 14883 raft_consensus.cc:482] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:42:53.938381 14883 raft_consensus.cc:504] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:53.940326 14883 leader_election.cc:288] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215), e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811)
I20260807 10:42:53.946488 14679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.940706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33215 (local address 127.11.46.131:48919)
0807 10:42:53.941157 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:53.941181 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:53.941349 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:53.941744 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:53.941749 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:53.941790 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:53.941973 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.941983 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.942968 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.942973 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.944415 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.944434 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.945859 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.945866 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.946042 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.946072 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:42:53.946153 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 10:42:53.946259 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":69}
I20260807 10:42:53.946619 14871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.941012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:48919 (local address 127.11.46.129:33215)
0807 10:42:53.941270 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:53.941276 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:53.941299 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:42:53.941538 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:53.941543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:53.941614 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:53.941692 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:53.942115 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.942830 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.944612 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.945638 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.945794 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.945873 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:53.946208 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 10:42:53.946351 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:42:53.947750 14872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.940863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:50161 (local address 127.11.46.130:35811)
0807 10:42:53.941134 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:53.941142 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:53.941880 (+ 738us) server_negotiation.cc:407] Connection header received
0807 10:42:53.942062 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:53.942066 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:53.942131 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:53.942208 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:53.942782 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.943513 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.945554 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.946634 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.946810 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.946884 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:53.947347 (+ 463us) server_negotiation.cc:299] Negotiation successful
0807 10:42:53.947488 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:42:53.947829 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:53.940826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:35811 (local address 127.11.46.131:50161)
0807 10:42:53.941755 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:53.941771 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:53.941914 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:53.942241 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:53.942245 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:53.942272 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:53.942614 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.942623 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.943678 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.943682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.945334 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:53.945350 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:53.947047 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:53.947052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:53.947175 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:53.947201 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 10:42:53.947286 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 10:42:53.947424 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":808,"mutex_wait_us":22,"thread_start_us":520,"threads_started":1}
I20260807 10:42:53.947674 14362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "812be8dfd16f474faf9bd21793258346" candidate_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de3dda642db423189b4313bda42a045" is_pre_election: true
I20260807 10:42:53.948277 14362 raft_consensus.cc:2454] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e87ecd1b20424db49bf7e7b44ad9d697 in term 0.
I20260807 10:42:53.948927 14564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "812be8dfd16f474faf9bd21793258346" candidate_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47173c962324e9d89bc83f9b829af3b" is_pre_election: true
I20260807 10:42:53.949081 14665 leader_election.cc:302] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de3dda642db423189b4313bda42a045, e87ecd1b20424db49bf7e7b44ad9d697; no voters:
I20260807 10:42:53.949466 14564 raft_consensus.cc:2454] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e87ecd1b20424db49bf7e7b44ad9d697 in term 0.
I20260807 10:42:53.949565 14883 raft_consensus.cc:2781] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:42:53.949741 14883 raft_consensus.cc:482] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:42:53.949858 14883 raft_consensus.cc:3037] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:53.952224 14883 raft_consensus.cc:504] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:53.952940 14883 leader_election.cc:288] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [CANDIDATE]: Term 1 election: Requested vote from peers 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215), e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811)
I20260807 10:42:53.953601 14564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "812be8dfd16f474faf9bd21793258346" candidate_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47173c962324e9d89bc83f9b829af3b"
I20260807 10:42:53.953601 14362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "812be8dfd16f474faf9bd21793258346" candidate_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de3dda642db423189b4313bda42a045"
I20260807 10:42:53.953860 14564 raft_consensus.cc:3037] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:53.953861 14362 raft_consensus.cc:3037] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:53.957412 14564 raft_consensus.cc:2454] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87ecd1b20424db49bf7e7b44ad9d697 in term 1.
I20260807 10:42:53.957412 14362 raft_consensus.cc:2454] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87ecd1b20424db49bf7e7b44ad9d697 in term 1.
I20260807 10:42:53.958117 14665 leader_election.cc:302] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de3dda642db423189b4313bda42a045, e87ecd1b20424db49bf7e7b44ad9d697; no voters:
I20260807 10:42:53.958535 14883 raft_consensus.cc:2781] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:53.959050 14883 raft_consensus.cc:686] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 LEADER]: Becoming Leader. State: Replica: e87ecd1b20424db49bf7e7b44ad9d697, State: Running, Role: LEADER
I20260807 10:42:53.959663 14883 consensus_queue.cc:237] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:53.964833 14121 catalog_manager.cc:5495] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 reported cstate change: term changed from 0 to 1, leader changed from <none> to e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131). New cstate: current_term: 1 leader_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } health_report { overall_health: HEALTHY } } }
W20260807 10:42:53.990126 14638 tablet.cc:2369] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 10:42:54 dist-test-slave-42z9 krb5kdc[14050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099371, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:54.050539 14901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.036290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:38933 (local address 127.0.0.1:58428)
0807 10:42:54.036948 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:54.036965 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:54.037106 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:54.037488 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:54.037493 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:54.038261 (+ 768us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:42:54.038566 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.038576 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.039674 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.039678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.040670 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.040683 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.041504 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.041511 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.041654 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.042331 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:42:54.042350 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:42:54.044762 (+ 2412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:42:54.048013 (+ 3251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:54.048030 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:54.048037 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:54.048516 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:54.048880 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:42:54.048884 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:42:54.048886 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:42:54.049036 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:42:54.049588 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:42:54.049595 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:42:54.049774 (+ 179us) client_negotiation.cc:769] Sending connection context
0807 10:42:54.049936 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 10:42:54.050183 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":395,"threads_started":1}
I20260807 10:42:54.050590 14677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.036202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58428 (local address 127.11.46.190:38933)
0807 10:42:54.036406 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:54.036412 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:54.037057 (+ 645us) server_negotiation.cc:407] Connection header received
0807 10:42:54.037229 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:54.037233 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:54.037300 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:54.037387 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:54.038730 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.039541 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.040821 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.041273 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.041378 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.044995 (+ 3617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:54.045001 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:54.045004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:54.045052 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:54.047838 (+ 2786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:54.048636 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:54.048641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:54.048643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:54.048779 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:54.049128 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:54.049131 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:54.049133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:54.049428 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:54.049601 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:54.050046 (+ 445us) server_negotiation.cc:299] Negotiation successful
0807 10:42:54.050310 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":55}
I20260807 10:42:54.056334 14121 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:58428:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 10:42:54.057624 14121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:42:54.065161 14530 tablet_service.cc:1467] Processing CreateTablet for tablet c6595ecb9ea444a295bc45b22904ca77 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=21863d3fc6be4be4bde43172e908fa85]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:42:54.065097 14325 tablet_service.cc:1467] Processing CreateTablet for tablet c6595ecb9ea444a295bc45b22904ca77 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=21863d3fc6be4be4bde43172e908fa85]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:42:54.065426 14740 tablet_service.cc:1467] Processing CreateTablet for tablet c6595ecb9ea444a295bc45b22904ca77 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=21863d3fc6be4be4bde43172e908fa85]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:42:54.066279 14530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6595ecb9ea444a295bc45b22904ca77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:54.066282 14325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6595ecb9ea444a295bc45b22904ca77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:54.066325 14740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6595ecb9ea444a295bc45b22904ca77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:54.071976 14878 tablet_bootstrap.cc:492] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: Bootstrap starting.
I20260807 10:42:54.073570 14878 tablet_bootstrap.cc:654] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:54.074030 14880 tablet_bootstrap.cc:492] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: Bootstrap starting.
I20260807 10:42:54.076061 14880 tablet_bootstrap.cc:654] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:54.077380 14876 tablet_bootstrap.cc:492] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: Bootstrap starting.
I20260807 10:42:54.079414 14876 tablet_bootstrap.cc:654] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:54.081259 14878 tablet_bootstrap.cc:492] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: No bootstrap required, opened a new log
I20260807 10:42:54.081473 14878 ts_tablet_manager.cc:1397] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260807 10:42:54.081909 14880 tablet_bootstrap.cc:492] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: No bootstrap required, opened a new log
I20260807 10:42:54.082033 14876 tablet_bootstrap.cc:492] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: No bootstrap required, opened a new log
I20260807 10:42:54.082068 14880 ts_tablet_manager.cc:1397] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260807 10:42:54.082197 14876 ts_tablet_manager.cc:1397] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260807 10:42:54.082379 14878 raft_consensus.cc:348] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.082628 14878 raft_consensus.cc:374] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:54.082731 14878 raft_consensus.cc:729] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87ecd1b20424db49bf7e7b44ad9d697, State: Initialized, Role: FOLLOWER
I20260807 10:42:54.082785 14880 raft_consensus.cc:348] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.083048 14880 raft_consensus.cc:374] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:54.082983 14878 consensus_queue.cc:260] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.083148 14880 raft_consensus.cc:729] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47173c962324e9d89bc83f9b829af3b, State: Initialized, Role: FOLLOWER
I20260807 10:42:54.083010 14876 raft_consensus.cc:348] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.083238 14876 raft_consensus.cc:374] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:54.083335 14876 raft_consensus.cc:729] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de3dda642db423189b4313bda42a045, State: Initialized, Role: FOLLOWER
I20260807 10:42:54.083367 14880 consensus_queue.cc:260] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.083474 14883 tablet_replica.cc:439] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } } }
I20260807 10:42:54.083781 14883 tablet_replica.cc:442] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:54.083591 14876 consensus_queue.cc:260] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.083992 14880 ts_tablet_manager.cc:1428] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:42:54.084445 14876 ts_tablet_manager.cc:1428] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:42:54.084414 14884 tablet_replica.cc:439] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } } }
I20260807 10:42:54.084753 14884 tablet_replica.cc:442] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:54.084745 14881 tablet_replica.cc:439] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } } }
I20260807 10:42:54.085018 14881 tablet_replica.cc:442] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:54.087013 14878 ts_tablet_manager.cc:1428] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260807 10:42:54.192058 14884 raft_consensus.cc:482] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:42:54.192327 14884 raft_consensus.cc:504] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.194021 14884 leader_election.cc:288] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215), e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227)
I20260807 10:42:54.200944 14871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.194489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:60839 (local address 127.11.46.129:33215)
0807 10:42:54.194703 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:54.194711 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:54.195134 (+ 423us) server_negotiation.cc:407] Connection header received
0807 10:42:54.195375 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:54.195382 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:54.195482 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:54.195580 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:54.196265 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.197046 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.199017 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.199917 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.200078 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.200159 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:54.200539 (+ 380us) server_negotiation.cc:299] Negotiation successful
0807 10:42:54.200656 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:42:54.201159 14874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.195297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:36803 (local address 127.11.46.131:44227)
0807 10:42:54.195496 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:54.195502 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:54.195853 (+ 351us) server_negotiation.cc:407] Connection header received
0807 10:42:54.196039 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:54.196043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:54.196105 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:54.196182 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:54.196765 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.197488 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.199284 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.200198 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.200360 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.200455 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:54.200796 (+ 341us) server_negotiation.cc:299] Negotiation successful
0807 10:42:54.200927 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:42:54.201140 14909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.194351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33215 (local address 127.11.46.130:60839)
0807 10:42:54.194975 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:54.194992 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:54.195192 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:54.195724 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:54.195730 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:54.195762 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:54.196101 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.196109 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.197189 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.197193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.198846 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.198861 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.200142 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.200148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.200305 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.200341 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 10:42:54.200496 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 10:42:54.200642 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":47,"thread_start_us":350,"threads_started":1}
I20260807 10:42:54.201227 14910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.195089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:44227 (local address 127.11.46.130:36803)
0807 10:42:54.195750 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:54.195763 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:54.195907 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:54.196226 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:54.196230 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:54.196262 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:54.196611 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.196620 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.197632 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.197636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.199108 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.199122 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.200436 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.200443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.200631 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.200663 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 10:42:54.200752 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 10:42:54.200882 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":1,"thread_start_us":349,"threads_started":1}
I20260807 10:42:54.202086 14362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6595ecb9ea444a295bc45b22904ca77" candidate_uuid: "e47173c962324e9d89bc83f9b829af3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de3dda642db423189b4313bda42a045" is_pre_election: true
I20260807 10:42:54.202226 14770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6595ecb9ea444a295bc45b22904ca77" candidate_uuid: "e47173c962324e9d89bc83f9b829af3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" is_pre_election: true
I20260807 10:42:54.202383 14362 raft_consensus.cc:2454] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47173c962324e9d89bc83f9b829af3b in term 0.
I20260807 10:42:54.202636 14770 raft_consensus.cc:2454] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47173c962324e9d89bc83f9b829af3b in term 0.
I20260807 10:42:54.202878 14460 leader_election.cc:302] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de3dda642db423189b4313bda42a045, e47173c962324e9d89bc83f9b829af3b; no voters:
I20260807 10:42:54.203326 14884 raft_consensus.cc:2781] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:42:54.203454 14884 raft_consensus.cc:482] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:42:54.203560 14884 raft_consensus.cc:3037] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:54.205933 14884 raft_consensus.cc:504] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.206570 14884 leader_election.cc:288] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [CANDIDATE]: Term 1 election: Requested vote from peers 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215), e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227)
I20260807 10:42:54.207159 14770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6595ecb9ea444a295bc45b22904ca77" candidate_uuid: "e47173c962324e9d89bc83f9b829af3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87ecd1b20424db49bf7e7b44ad9d697"
I20260807 10:42:54.207161 14362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6595ecb9ea444a295bc45b22904ca77" candidate_uuid: "e47173c962324e9d89bc83f9b829af3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de3dda642db423189b4313bda42a045"
I20260807 10:42:54.207350 14770 raft_consensus.cc:3037] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:54.207376 14362 raft_consensus.cc:3037] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:54.209486 14362 raft_consensus.cc:2454] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47173c962324e9d89bc83f9b829af3b in term 1.
I20260807 10:42:54.209535 14770 raft_consensus.cc:2454] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47173c962324e9d89bc83f9b829af3b in term 1.
I20260807 10:42:54.209913 14460 leader_election.cc:302] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de3dda642db423189b4313bda42a045, e47173c962324e9d89bc83f9b829af3b; no voters:
I20260807 10:42:54.210213 14884 raft_consensus.cc:2781] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:54.210711 14884 raft_consensus.cc:686] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [term 1 LEADER]: Becoming Leader. State: Replica: e47173c962324e9d89bc83f9b829af3b, State: Running, Role: LEADER
I20260807 10:42:54.211320 14884 consensus_queue.cc:237] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.214843 14913 tablet_replica.cc:439] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: TxnStatusTablet state changed. Reason: New leader e47173c962324e9d89bc83f9b829af3b. Latest consensus state: current_term: 1 leader_uuid: "e47173c962324e9d89bc83f9b829af3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } } }
I20260807 10:42:54.215346 14913 tablet_replica.cc:442] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:42:54.216121 14915 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 10:42:54.216382 14915 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 10:42:54.216468 14121 catalog_manager.cc:5495] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b reported cstate change: term changed from 0 to 1, leader changed from <none> to e47173c962324e9d89bc83f9b829af3b (127.11.46.130). New cstate: current_term: 1 leader_uuid: "e47173c962324e9d89bc83f9b829af3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260807 10:42:54.249541 14901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.242647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:35811 (local address 127.0.0.1:49032)
0807 10:42:54.242903 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:54.242927 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:54.243110 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:54.243629 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:54.243633 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:54.243647 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:42:54.243858 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.243871 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.245497 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.245503 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.246522 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.246539 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.247585 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.247590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.247739 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.247810 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:42:54.249008 (+ 1198us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:42:54.249031 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 10:42:54.249107 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 10:42:54.249249 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 10:42:54.249641 14872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.242813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49032 (local address 127.11.46.130:35811)
0807 10:42:54.243047 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:54.243053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:54.243075 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:42:54.243346 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:54.243351 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:54.243441 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:54.243587 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:54.244036 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.245308 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.246700 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.247396 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.247541 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.248026 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:54.248855 (+ 829us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:54.249043 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:54.249147 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 10:42:54.249255 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:42:54.260243 14362 raft_consensus.cc:1261] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Refusing update from remote peer e47173c962324e9d89bc83f9b829af3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:54.260216 14770 raft_consensus.cc:1261] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Refusing update from remote peer e47173c962324e9d89bc83f9b829af3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:54.261504 14913 consensus_queue.cc:1035] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:54.262076 14884 consensus_queue.cc:1035] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:54.279773 14883 tablet_replica.cc:439] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: TxnStatusTablet state changed. Reason: New leader e47173c962324e9d89bc83f9b829af3b. Latest consensus state: current_term: 1 leader_uuid: "e47173c962324e9d89bc83f9b829af3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } } }
I20260807 10:42:54.280218 14883 tablet_replica.cc:442] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:54.282078 14881 tablet_replica.cc:439] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: TxnStatusTablet state changed. Reason: New leader e47173c962324e9d89bc83f9b829af3b. Latest consensus state: current_term: 1 leader_uuid: "e47173c962324e9d89bc83f9b829af3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } } }
I20260807 10:42:54.282407 14881 tablet_replica.cc:442] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:54.284091 14919 mvcc.cc:205] Tried to move back new op lower bound from 7315863036955828224 to 7315863036773498880. Current Snapshot: MvccSnapshot[applied={T|T < 7315863036955828224}]
I20260807 10:42:54.285565 14913 tablet_replica.cc:439] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e47173c962324e9d89bc83f9b829af3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } } }
I20260807 10:42:54.285877 14913 tablet_replica.cc:442] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:42:54.286136 14913 tablet_replica.cc:439] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e47173c962324e9d89bc83f9b829af3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } } }
I20260807 10:42:54.286392 14913 tablet_replica.cc:442] T c6595ecb9ea444a295bc45b22904ca77 P e47173c962324e9d89bc83f9b829af3b: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:42:54.286720 14921 mvcc.cc:205] Tried to move back new op lower bound from 7315863036955828224 to 7315863036773498880. Current Snapshot: MvccSnapshot[applied={T|T < 7315863036955828224}]
I20260807 10:42:54.290247 14881 tablet_replica.cc:439] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e47173c962324e9d89bc83f9b829af3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } } }
I20260807 10:42:54.290221 14883 tablet_replica.cc:439] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e47173c962324e9d89bc83f9b829af3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } } }
I20260807 10:42:54.290539 14881 tablet_replica.cc:442] T c6595ecb9ea444a295bc45b22904ca77 P 7de3dda642db423189b4313bda42a045: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:54.290567 14883 tablet_replica.cc:442] T c6595ecb9ea444a295bc45b22904ca77 P e87ecd1b20424db49bf7e7b44ad9d697: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:42:54.308403 14874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.301161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56146 (local address 127.11.46.131:44227)
0807 10:42:54.301394 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:54.301402 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:54.301891 (+ 489us) server_negotiation.cc:407] Connection header received
0807 10:42:54.302151 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:54.302155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:54.302260 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:54.302400 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:54.302845 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.303622 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.305850 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.306349 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.306455 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.307058 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:54.307737 (+ 679us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:54.307863 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:54.308005 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 10:42:54.308093 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:42:54.326996 14872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.321330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:58987 (local address 127.11.46.130:35811)
0807 10:42:54.321600 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:54.321606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:54.322036 (+ 430us) server_negotiation.cc:407] Connection header received
0807 10:42:54.322249 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:54.322254 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:54.322330 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:54.322415 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:54.322941 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.323711 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.325103 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.325595 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.325731 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.326220 (+ 489us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:54.326343 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:54.326437 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:54.326579 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 10:42:54.326673 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:42:54.327085 14937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.321214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:35811 (local address 127.11.46.131:58987)
0807 10:42:54.321918 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:54.321935 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:54.322095 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:54.322455 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:54.322460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:54.322473 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:42:54.322782 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.322791 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.323853 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.323858 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.324956 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.324969 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.325789 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.325796 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.325939 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.326002 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:42:54.326455 (+ 453us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:42:54.326469 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 10:42:54.326540 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 10:42:54.326696 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":389,"threads_started":1}
I20260807 10:42:54.338215 14362 raft_consensus.cc:1261] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Refusing update from remote peer e87ecd1b20424db49bf7e7b44ad9d697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:54.338364 14564 raft_consensus.cc:1261] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Refusing update from remote peer e87ecd1b20424db49bf7e7b44ad9d697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:54.339155 14888 consensus_queue.cc:1035] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:54.339847 14883 consensus_queue.cc:1035] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:54.384505 14874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.377025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:60453 (local address 127.11.46.131:44227)
0807 10:42:54.377244 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:54.377250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:54.377725 (+ 475us) server_negotiation.cc:407] Connection header received
0807 10:42:54.377967 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:54.377973 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:54.378065 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:54.378166 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:54.378881 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.379912 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.382208 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.382853 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.382994 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.383507 (+ 513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:54.383627 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:54.383709 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:54.384121 (+ 412us) server_negotiation.cc:299] Negotiation successful
0807 10:42:54.384214 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 10:42:54.384684 14948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:54.376873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:44227 (local address 127.11.46.130:60453)
0807 10:42:54.377598 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:54.377625 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:54.377798 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:54.378199 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:54.378204 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:54.378218 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:42:54.378689 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.378703 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.380054 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.380060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.382014 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:54.382036 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:54.383051 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:54.383058 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:54.383232 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:54.383306 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:42:54.383770 (+ 464us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:42:54.383783 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 10:42:54.383915 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 10:42:54.384200 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":391,"threads_started":1}
I20260807 10:42:54.438704 14121 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58412:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:54.439014 14121 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58412:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:54.442941 14121 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8: Sending DeleteTablet for 3 replicas of tablet 812be8dfd16f474faf9bd21793258346
I20260807 10:42:54.444388 14325 tablet_service.cc:1514] Processing DeleteTablet for tablet 812be8dfd16f474faf9bd21793258346 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:54 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:33456
I20260807 10:42:54.445163 14740 tablet_service.cc:1514] Processing DeleteTablet for tablet 812be8dfd16f474faf9bd21793258346 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:54 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:56130
I20260807 10:42:54.446579 14530 tablet_service.cc:1514] Processing DeleteTablet for tablet 812be8dfd16f474faf9bd21793258346 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:54 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:49024
I20260807 10:42:54.448717 14121 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58412:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 10:42:54.449975 14953 tablet_replica.cc:330] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: stopping tablet replica
W20260807 10:42:54.450295 14121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:42:54.450575 14953 raft_consensus.cc:2229] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:42:54.451346 14953 raft_consensus.cc:2258] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:54.462918 14740 tablet_service.cc:1467] Processing CreateTablet for tablet c5efdef21c0a47289866cb36952b0df8 (DEFAULT_TABLE table=test-table [id=9968e44702d9482a9a254181e4400867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:54.462906 14324 tablet_service.cc:1467] Processing CreateTablet for tablet c5efdef21c0a47289866cb36952b0df8 (DEFAULT_TABLE table=test-table [id=9968e44702d9482a9a254181e4400867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:54.463636 14740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5efdef21c0a47289866cb36952b0df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:54.463678 14324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5efdef21c0a47289866cb36952b0df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:54.473100 14953 ts_tablet_manager.cc:1905] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:54.473748 14876 tablet_bootstrap.cc:492] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045: Bootstrap starting.
I20260807 10:42:54.475912 14876 tablet_bootstrap.cc:654] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:54.476019 14878 tablet_bootstrap.cc:492] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697: Bootstrap starting.
I20260807 10:42:54.479986 14952 tablet_replica.cc:330] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: stopping tablet replica
I20260807 10:42:54.480715 14952 raft_consensus.cc:2229] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:54.482100 14952 raft_consensus.cc:2258] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:54.484026 14878 tablet_bootstrap.cc:654] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:54.484786 14952 ts_tablet_manager.cc:1905] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:54.488665 14876 tablet_bootstrap.cc:492] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045: No bootstrap required, opened a new log
I20260807 10:42:54.488930 14876 ts_tablet_manager.cc:1397] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.000s
I20260807 10:42:54.489995 14876 raft_consensus.cc:348] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.490316 14876 raft_consensus.cc:374] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:54.490401 14876 raft_consensus.cc:729] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de3dda642db423189b4313bda42a045, State: Initialized, Role: FOLLOWER
I20260807 10:42:54.490770 14876 consensus_queue.cc:260] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.492340 14876 ts_tablet_manager.cc:1428] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 10:42:54.498481 14878 tablet_bootstrap.cc:492] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697: No bootstrap required, opened a new log
I20260807 10:42:54.498705 14529 tablet_service.cc:1467] Processing CreateTablet for tablet c5efdef21c0a47289866cb36952b0df8 (DEFAULT_TABLE table=test-table [id=9968e44702d9482a9a254181e4400867]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:54.499840 14529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5efdef21c0a47289866cb36952b0df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:54.499871 14878 ts_tablet_manager.cc:1397] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.003s
I20260807 10:42:54.499926 14953 ts_tablet_manager.cc:1918] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:42:54.500180 14953 log.cc:1196] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/812be8dfd16f474faf9bd21793258346
I20260807 10:42:54.501045 14953 ts_tablet_manager.cc:1939] T 812be8dfd16f474faf9bd21793258346 P e87ecd1b20424db49bf7e7b44ad9d697: Deleting consensus metadata
I20260807 10:42:54.501025 14878 raft_consensus.cc:348] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.501320 14878 raft_consensus.cc:374] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:54.501421 14878 raft_consensus.cc:729] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87ecd1b20424db49bf7e7b44ad9d697, State: Initialized, Role: FOLLOWER
I20260807 10:42:54.501789 14878 consensus_queue.cc:260] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.502467 14878 ts_tablet_manager.cc:1428] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 10:42:54.504748 14101 catalog_manager.cc:4841] TS e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227): tablet 812be8dfd16f474faf9bd21793258346 (table test-table [id=9ef5f57fdbd24b89b4267c98b4bc6402]) successfully deleted
I20260807 10:42:54.505191 14952 ts_tablet_manager.cc:1918] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:42:54.505540 14952 log.cc:1196] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/812be8dfd16f474faf9bd21793258346
I20260807 10:42:54.507179 14952 ts_tablet_manager.cc:1939] T 812be8dfd16f474faf9bd21793258346 P 7de3dda642db423189b4313bda42a045: Deleting consensus metadata
I20260807 10:42:54.507254 14954 tablet_replica.cc:330] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: stopping tablet replica
I20260807 10:42:54.507803 14954 raft_consensus.cc:2229] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:54.508190 14954 raft_consensus.cc:2258] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:54.510506 14954 ts_tablet_manager.cc:1905] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:54.510907 14101 catalog_manager.cc:4841] TS 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215): tablet 812be8dfd16f474faf9bd21793258346 (table test-table [id=9ef5f57fdbd24b89b4267c98b4bc6402]) successfully deleted
I20260807 10:42:54.513844 14880 tablet_bootstrap.cc:492] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b: Bootstrap starting.
I20260807 10:42:54.516075 14880 tablet_bootstrap.cc:654] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:54.520151 14954 ts_tablet_manager.cc:1918] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:42:54.520437 14954 log.cc:1196] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/812be8dfd16f474faf9bd21793258346
I20260807 10:42:54.521111 14954 ts_tablet_manager.cc:1939] T 812be8dfd16f474faf9bd21793258346 P e47173c962324e9d89bc83f9b829af3b: Deleting consensus metadata
I20260807 10:42:54.523527 14102 catalog_manager.cc:4841] TS e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811): tablet 812be8dfd16f474faf9bd21793258346 (table test-table [id=9ef5f57fdbd24b89b4267c98b4bc6402]) successfully deleted
I20260807 10:42:54.525810 14880 tablet_bootstrap.cc:492] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b: No bootstrap required, opened a new log
I20260807 10:42:54.526026 14880 ts_tablet_manager.cc:1397] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260807 10:42:54.527395 14880 raft_consensus.cc:348] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.528183 14880 raft_consensus.cc:374] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:54.528270 14880 raft_consensus.cc:729] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47173c962324e9d89bc83f9b829af3b, State: Initialized, Role: FOLLOWER
I20260807 10:42:54.528558 14880 consensus_queue.cc:260] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.529289 14880 ts_tablet_manager.cc:1428] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 10:42:54.616372 14942 raft_consensus.cc:482] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:42:54.616678 14942 raft_consensus.cc:504] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.617728 14942 leader_election.cc:288] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215), e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811)
I20260807 10:42:54.618741 14361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efdef21c0a47289866cb36952b0df8" candidate_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de3dda642db423189b4313bda42a045" is_pre_election: true
I20260807 10:42:54.619087 14361 raft_consensus.cc:2454] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e87ecd1b20424db49bf7e7b44ad9d697 in term 0.
I20260807 10:42:54.619903 14665 leader_election.cc:302] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de3dda642db423189b4313bda42a045, e87ecd1b20424db49bf7e7b44ad9d697; no voters:
I20260807 10:42:54.620702 14564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efdef21c0a47289866cb36952b0df8" candidate_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47173c962324e9d89bc83f9b829af3b" is_pre_election: true
I20260807 10:42:54.620998 14564 raft_consensus.cc:2454] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e87ecd1b20424db49bf7e7b44ad9d697 in term 0.
I20260807 10:42:54.621819 14942 raft_consensus.cc:2781] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:42:54.621978 14942 raft_consensus.cc:482] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:42:54.622088 14942 raft_consensus.cc:3037] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:54.625732 14942 raft_consensus.cc:504] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.627236 14361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efdef21c0a47289866cb36952b0df8" candidate_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7de3dda642db423189b4313bda42a045"
I20260807 10:42:54.627525 14361 raft_consensus.cc:3037] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:54.630929 14361 raft_consensus.cc:2454] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87ecd1b20424db49bf7e7b44ad9d697 in term 1.
I20260807 10:42:54.631587 14665 leader_election.cc:302] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de3dda642db423189b4313bda42a045, e87ecd1b20424db49bf7e7b44ad9d697; no voters:
I20260807 10:42:54.632012 14883 raft_consensus.cc:2781] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:54.632182 14883 raft_consensus.cc:686] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 LEADER]: Becoming Leader. State: Replica: e87ecd1b20424db49bf7e7b44ad9d697, State: Running, Role: LEADER
I20260807 10:42:54.632506 14883 consensus_queue.cc:237] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:54.636971 14942 leader_election.cc:288] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [CANDIDATE]: Term 1 election: Requested vote from peers 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215), e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811)
I20260807 10:42:54.637177 14564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5efdef21c0a47289866cb36952b0df8" candidate_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47173c962324e9d89bc83f9b829af3b"
I20260807 10:42:54.637516 14564 raft_consensus.cc:3037] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:54.641070 14564 raft_consensus.cc:2454] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e87ecd1b20424db49bf7e7b44ad9d697 in term 1.
I20260807 10:42:54.643204 14120 catalog_manager.cc:5495] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 reported cstate change: term changed from 0 to 1, leader changed from <none> to e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131). New cstate: current_term: 1 leader_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } health_report { overall_health: HEALTHY } } }
I20260807 10:42:54.721930 14362 raft_consensus.cc:1261] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Refusing update from remote peer e87ecd1b20424db49bf7e7b44ad9d697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:54.722733 14942 consensus_queue.cc:1035] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:54.726178 14564 raft_consensus.cc:1261] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Refusing update from remote peer e87ecd1b20424db49bf7e7b44ad9d697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:54.727319 14942 consensus_queue.cc:1035] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 10:42:54.777294 14921 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 10:42:56.385874 14120 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58412:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:56.386193 14120 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58412:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:56.391804 14120 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8: Sending DeleteTablet for 3 replicas of tablet c5efdef21c0a47289866cb36952b0df8
I20260807 10:42:56.393385 14529 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efdef21c0a47289866cb36952b0df8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:56 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:49024
I20260807 10:42:56.393570 14324 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efdef21c0a47289866cb36952b0df8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:56 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:33456
I20260807 10:42:56.397739 14740 tablet_service.cc:1514] Processing DeleteTablet for tablet c5efdef21c0a47289866cb36952b0df8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:56 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:56130
I20260807 10:42:56.402733 14989 tablet_replica.cc:330] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697: stopping tablet replica
I20260807 10:42:56.403122 14989 raft_consensus.cc:2229] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:42:56.403784 14989 raft_consensus.cc:2258] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:56.406154 14988 tablet_replica.cc:330] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045: stopping tablet replica
I20260807 10:42:56.406505 14988 raft_consensus.cc:2229] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:56.406904 14988 raft_consensus.cc:2258] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:56.407271 14989 ts_tablet_manager.cc:1905] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:56.408744 14988 ts_tablet_manager.cc:1905] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:56.412760 14987 tablet_replica.cc:330] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b: stopping tablet replica
I20260807 10:42:56.413033 14987 raft_consensus.cc:2229] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:56.413357 14987 raft_consensus.cc:2258] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:56.414618 14987 ts_tablet_manager.cc:1905] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:56.415827 14989 ts_tablet_manager.cc:1918] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:42:56.415975 14989 log.cc:1196] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/c5efdef21c0a47289866cb36952b0df8
I20260807 10:42:56.416041 14988 ts_tablet_manager.cc:1918] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:42:56.416199 14988 log.cc:1196] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/c5efdef21c0a47289866cb36952b0df8
I20260807 10:42:56.416440 14989 ts_tablet_manager.cc:1939] T c5efdef21c0a47289866cb36952b0df8 P e87ecd1b20424db49bf7e7b44ad9d697: Deleting consensus metadata
I20260807 10:42:56.416646 14988 ts_tablet_manager.cc:1939] T c5efdef21c0a47289866cb36952b0df8 P 7de3dda642db423189b4313bda42a045: Deleting consensus metadata
I20260807 10:42:56.417896 14101 catalog_manager.cc:4841] TS e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227): tablet c5efdef21c0a47289866cb36952b0df8 (table test-table [id=9968e44702d9482a9a254181e4400867]) successfully deleted
I20260807 10:42:56.418212 14101 catalog_manager.cc:4841] TS 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215): tablet c5efdef21c0a47289866cb36952b0df8 (table test-table [id=9968e44702d9482a9a254181e4400867]) successfully deleted
I20260807 10:42:56.420912 14987 ts_tablet_manager.cc:1918] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:42:56.421075 14987 log.cc:1196] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/c5efdef21c0a47289866cb36952b0df8
I20260807 10:42:56.421481 14987 ts_tablet_manager.cc:1939] T c5efdef21c0a47289866cb36952b0df8 P e47173c962324e9d89bc83f9b829af3b: Deleting consensus metadata
I20260807 10:42:56.422611 14102 catalog_manager.cc:4841] TS e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811): tablet c5efdef21c0a47289866cb36952b0df8 (table test-table [id=9968e44702d9482a9a254181e4400867]) successfully deleted
Aug 07 10:42:56 dist-test-slave-42z9 krb5kdc[14050](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099376, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 10:42:56 dist-test-slave-42z9 krb5kdc[14050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099376, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:42:56.468874 15004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:56.453695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58434 (local address 127.11.46.190:38933)
0807 10:42:56.454238 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:56.454243 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:56.454294 (+ 51us) server_negotiation.cc:407] Connection header received
0807 10:42:56.454490 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:56.454494 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:56.454567 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:56.454661 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:56.456128 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.456977 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.458411 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.458897 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.459012 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:56.463331 (+ 4319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:56.463337 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:56.463341 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:56.463383 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:56.466301 (+ 2918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:56.467097 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:56.467101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:56.467104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:56.467257 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:56.467590 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:56.467593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:56.467595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:56.467887 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:56.468081 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:56.468382 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 10:42:56.468594 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":283,"threads_started":1}
I20260807 10:42:56.473124 14120 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:42:56.473889 14120 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:42:56.482088 14324 tablet_service.cc:1467] Processing CreateTablet for tablet 72b32f396e7348f38542645226a03a6a (DEFAULT_TABLE table=test-table [id=055e66b3c68d4f449d98a6b2461815cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:56.482424 14740 tablet_service.cc:1467] Processing CreateTablet for tablet 72b32f396e7348f38542645226a03a6a (DEFAULT_TABLE table=test-table [id=055e66b3c68d4f449d98a6b2461815cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:56.482422 14529 tablet_service.cc:1467] Processing CreateTablet for tablet 72b32f396e7348f38542645226a03a6a (DEFAULT_TABLE table=test-table [id=055e66b3c68d4f449d98a6b2461815cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:56.482656 14324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72b32f396e7348f38542645226a03a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:56.482874 14529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72b32f396e7348f38542645226a03a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:56.482869 14740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72b32f396e7348f38542645226a03a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:56.490044 15005 tablet_bootstrap.cc:492] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b: Bootstrap starting.
I20260807 10:42:56.491074 15009 tablet_bootstrap.cc:492] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697: Bootstrap starting.
I20260807 10:42:56.492113 15008 tablet_bootstrap.cc:492] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045: Bootstrap starting.
I20260807 10:42:56.493221 15009 tablet_bootstrap.cc:654] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:56.493466 15005 tablet_bootstrap.cc:654] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:56.493800 15008 tablet_bootstrap.cc:654] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:56.495862 15009 tablet_bootstrap.cc:492] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697: No bootstrap required, opened a new log
I20260807 10:42:56.495968 15005 tablet_bootstrap.cc:492] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b: No bootstrap required, opened a new log
I20260807 10:42:56.496069 15009 ts_tablet_manager.cc:1397] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 10:42:56.496122 15005 ts_tablet_manager.cc:1397] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 10:42:56.496093 15008 tablet_bootstrap.cc:492] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045: No bootstrap required, opened a new log
I20260807 10:42:56.496623 15008 ts_tablet_manager.cc:1397] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260807 10:42:56.496977 15009 raft_consensus.cc:348] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.496976 15005 raft_consensus.cc:348] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.497257 15009 raft_consensus.cc:374] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:56.497272 15005 raft_consensus.cc:374] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:56.497364 15009 raft_consensus.cc:729] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87ecd1b20424db49bf7e7b44ad9d697, State: Initialized, Role: FOLLOWER
I20260807 10:42:56.497385 15005 raft_consensus.cc:729] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47173c962324e9d89bc83f9b829af3b, State: Initialized, Role: FOLLOWER
I20260807 10:42:56.497581 15008 raft_consensus.cc:348] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.497658 15009 consensus_queue.cc:260] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.497658 15005 consensus_queue.cc:260] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.497844 15008 raft_consensus.cc:374] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:56.497951 15008 raft_consensus.cc:729] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de3dda642db423189b4313bda42a045, State: Initialized, Role: FOLLOWER
I20260807 10:42:56.498266 15005 ts_tablet_manager.cc:1428] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:42:56.498272 15009 ts_tablet_manager.cc:1428] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 10:42:56.498198 15008 consensus_queue.cc:260] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.499229 15008 ts_tablet_manager.cc:1428] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:42:56.559196 15015 raft_consensus.cc:482] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:42:56.559496 15015 raft_consensus.cc:504] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.561362 15015 leader_election.cc:288] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811), e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227)
I20260807 10:42:56.580904 15025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:56.561909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:43337 (local address 127.11.46.131:44227)
0807 10:42:56.574710 (+ 12801us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:56.574716 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:56.574743 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:42:56.574810 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:56.574814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:56.574885 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:56.574976 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:56.575609 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.576421 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.578803 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.579704 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.579930 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:56.580025 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:56.580332 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 10:42:56.580506 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12612,"thread_start_us":12730,"threads_started":1}
I20260807 10:42:56.580953 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:56.561834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:34695 (local address 127.11.46.130:35811)
0807 10:42:56.573949 (+ 12115us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:56.573956 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:56.574671 (+ 715us) server_negotiation.cc:407] Connection header received
0807 10:42:56.574835 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:56.574839 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:56.574904 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:56.574990 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:42:56.575771 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.576565 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.578941 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.579816 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.580004 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:56.580089 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:56.580419 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 10:42:56.580598 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11894,"thread_start_us":11665,"threads_started":1}
I20260807 10:42:56.580976 15019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:56.561754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:44227 (local address 127.11.46.129:43337)
0807 10:42:56.574286 (+ 12532us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:56.574316 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:56.574529 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:56.575029 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:56.575035 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:56.575061 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:56.575427 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:56.575442 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.576582 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.576586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:56.578577 (+ 1991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:56.578600 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.579944 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.579952 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:56.580160 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:56.580190 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:42:56.580281 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:42:56.580514 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12318,"mutex_wait_us":26,"thread_start_us":12085,"threads_started":1}
I20260807 10:42:56.581032 15021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:56.561838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:35811 (local address 127.11.46.129:34695)
0807 10:42:56.574533 (+ 12695us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:56.574549 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:56.574698 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:56.575039 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:56.575044 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:56.575111 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:42:56.575571 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:56.575586 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.576734 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.576738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:56.578753 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:56.578770 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.580075 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.580090 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:56.580256 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:56.580281 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 10:42:56.580368 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 10:42:56.580588 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12564,"mutex_wait_us":47,"spinlock_wait_cycles":4352,"thread_start_us":12290,"threads_started":1}
I20260807 10:42:56.582166 14770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72b32f396e7348f38542645226a03a6a" candidate_uuid: "7de3dda642db423189b4313bda42a045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" is_pre_election: true
I20260807 10:42:56.582166 14561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72b32f396e7348f38542645226a03a6a" candidate_uuid: "7de3dda642db423189b4313bda42a045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47173c962324e9d89bc83f9b829af3b" is_pre_election: true
I20260807 10:42:56.582471 14770 raft_consensus.cc:2454] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de3dda642db423189b4313bda42a045 in term 0.
I20260807 10:42:56.582466 14561 raft_consensus.cc:2454] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de3dda642db423189b4313bda42a045 in term 0.
I20260807 10:42:56.583115 14250 leader_election.cc:302] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de3dda642db423189b4313bda42a045, e47173c962324e9d89bc83f9b829af3b; no voters:
I20260807 10:42:56.583607 15015 raft_consensus.cc:2781] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:42:56.583745 15015 raft_consensus.cc:482] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:42:56.583847 15015 raft_consensus.cc:3037] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:56.586228 15015 raft_consensus.cc:504] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.586969 15015 leader_election.cc:288] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [CANDIDATE]: Term 1 election: Requested vote from peers e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811), e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227)
I20260807 10:42:56.587908 14770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72b32f396e7348f38542645226a03a6a" candidate_uuid: "7de3dda642db423189b4313bda42a045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87ecd1b20424db49bf7e7b44ad9d697"
I20260807 10:42:56.588011 14561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72b32f396e7348f38542645226a03a6a" candidate_uuid: "7de3dda642db423189b4313bda42a045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47173c962324e9d89bc83f9b829af3b"
I20260807 10:42:56.588195 14770 raft_consensus.cc:3037] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:56.588379 14561 raft_consensus.cc:3037] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:56.590642 14770 raft_consensus.cc:2454] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de3dda642db423189b4313bda42a045 in term 1.
I20260807 10:42:56.591179 14249 leader_election.cc:302] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de3dda642db423189b4313bda42a045, e87ecd1b20424db49bf7e7b44ad9d697; no voters:
I20260807 10:42:56.591261 14561 raft_consensus.cc:2454] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de3dda642db423189b4313bda42a045 in term 1.
I20260807 10:42:56.591609 15015 raft_consensus.cc:2781] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:56.592288 15015 raft_consensus.cc:686] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 1 LEADER]: Becoming Leader. State: Replica: 7de3dda642db423189b4313bda42a045, State: Running, Role: LEADER
I20260807 10:42:56.592888 15015 consensus_queue.cc:237] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.598114 14121 catalog_manager.cc:5495] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de3dda642db423189b4313bda42a045 (127.11.46.129). New cstate: current_term: 1 leader_uuid: "7de3dda642db423189b4313bda42a045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260807 10:42:56.634613 15030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:56.628124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33462 (local address 127.11.46.129:33215)
0807 10:42:56.628781 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:56.628786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:56.628806 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:42:56.628906 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:56.628909 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:56.629001 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:56.629169 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:56.629690 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.630521 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.631980 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.632492 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.632625 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:56.633126 (+ 501us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:56.633875 (+ 749us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:56.634025 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:56.634208 (+ 183us) server_negotiation.cc:299] Negotiation successful
0807 10:42:56.634304 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":384,"threads_started":1}
I20260807 10:42:56.652426 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:56.646410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:48697 (local address 127.11.46.130:35811)
0807 10:42:56.646700 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:56.646705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:56.647391 (+ 686us) server_negotiation.cc:407] Connection header received
0807 10:42:56.647555 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:56.647559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:56.647641 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:56.647729 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:56.648152 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.648882 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.650401 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.650926 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.651063 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:56.651594 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:56.651762 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:56.651844 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:56.651989 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 10:42:56.652095 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134}
I20260807 10:42:56.652529 15033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:56.646414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:35811 (local address 127.11.46.129:48697)
0807 10:42:56.647254 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:56.647276 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:56.647427 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:56.647750 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:56.647754 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:56.647763 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:42:56.648032 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:56.648041 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.649011 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.649015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:56.650219 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:56.650235 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.651143 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.651150 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:56.651307 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:56.651384 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:42:56.651867 (+ 483us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:42:56.651880 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 10:42:56.651953 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 10:42:56.652132 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":410,"threads_started":1}
I20260807 10:42:56.662565 14770 raft_consensus.cc:1261] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Refusing update from remote peer 7de3dda642db423189b4313bda42a045: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:56.662616 14561 raft_consensus.cc:1261] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Refusing update from remote peer 7de3dda642db423189b4313bda42a045: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:56.663275 15026 consensus_queue.cc:1035] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:56.663743 15015 consensus_queue.cc:1035] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:56.699409 15030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:56.691125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:47375 (local address 127.11.46.129:33215)
0807 10:42:56.691290 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:56.691297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:56.694085 (+ 2788us) server_negotiation.cc:407] Connection header received
0807 10:42:56.694374 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:56.694379 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:56.694477 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:56.694565 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:42:56.695094 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.695943 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.697338 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.697951 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.698070 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:56.698566 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:42:56.698711 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:42:56.698800 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:56.699010 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 10:42:56.699101 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 10:42:56.699595 15042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:56.690761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33215 (local address 127.11.46.130:47375)
0807 10:42:56.693987 (+ 3226us) negotiation.cc:107] Waiting for socket to connect
0807 10:42:56.694004 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:42:56.694208 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:42:56.694598 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:42:56.694601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:42:56.694612 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:42:56.694886 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:56.694910 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.696103 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.696109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:56.697186 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:42:56.697201 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:42:56.698118 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:42:56.698126 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:42:56.698317 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:56.698371 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:42:56.698827 (+ 456us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:42:56.698841 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 10:42:56.698977 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 10:42:56.699133 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3057,"thread_start_us":2901,"threads_started":1}
I20260807 10:42:56.733956 14121 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:56.734232 14121 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:56.737655 14121 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8: Sending DeleteTablet for 3 replicas of tablet 72b32f396e7348f38542645226a03a6a
I20260807 10:42:56.738732 14529 tablet_service.cc:1514] Processing DeleteTablet for tablet 72b32f396e7348f38542645226a03a6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:56 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:49024
I20260807 10:42:56.738817 14740 tablet_service.cc:1514] Processing DeleteTablet for tablet 72b32f396e7348f38542645226a03a6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:56 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:56130
I20260807 10:42:56.739138 14989 tablet_replica.cc:330] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697: stopping tablet replica
I20260807 10:42:56.739144 14987 tablet_replica.cc:330] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b: stopping tablet replica
I20260807 10:42:56.739372 14987 raft_consensus.cc:2229] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:56.739372 14989 raft_consensus.cc:2229] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:56.739590 14987 raft_consensus.cc:2258] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:56.739593 14989 raft_consensus.cc:2258] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:56.741034 14324 tablet_service.cc:1514] Processing DeleteTablet for tablet 72b32f396e7348f38542645226a03a6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:56 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:33456
I20260807 10:42:56.741312 14989 ts_tablet_manager.cc:1905] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:56.741359 14988 tablet_replica.cc:330] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045: stopping tablet replica
I20260807 10:42:56.741305 14121 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58434:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 10:42:56.741613 14988 raft_consensus.cc:2229] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 1 LEADER]: Raft consensus shutting down.
W20260807 10:42:56.742095 14121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:42:56.742197 14988 raft_consensus.cc:2258] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:56.743362 14988 ts_tablet_manager.cc:1905] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:56.744282 14987 ts_tablet_manager.cc:1905] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:56.749050 14989 ts_tablet_manager.cc:1918] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:42:56.749257 14989 log.cc:1196] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/72b32f396e7348f38542645226a03a6a
I20260807 10:42:56.749771 14989 ts_tablet_manager.cc:1939] T 72b32f396e7348f38542645226a03a6a P e87ecd1b20424db49bf7e7b44ad9d697: Deleting consensus metadata
I20260807 10:42:56.751137 14101 catalog_manager.cc:4841] TS e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227): tablet 72b32f396e7348f38542645226a03a6a (table test-table [id=055e66b3c68d4f449d98a6b2461815cf]) successfully deleted
I20260807 10:42:56.751199 14988 ts_tablet_manager.cc:1918] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:42:56.751377 14988 log.cc:1196] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/72b32f396e7348f38542645226a03a6a
I20260807 10:42:56.751866 14988 ts_tablet_manager.cc:1939] T 72b32f396e7348f38542645226a03a6a P 7de3dda642db423189b4313bda42a045: Deleting consensus metadata
I20260807 10:42:56.754038 14987 ts_tablet_manager.cc:1918] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:42:56.754480 14101 catalog_manager.cc:4841] TS 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215): tablet 72b32f396e7348f38542645226a03a6a (table test-table [id=055e66b3c68d4f449d98a6b2461815cf]) successfully deleted
I20260807 10:42:56.755714 14987 log.cc:1196] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/72b32f396e7348f38542645226a03a6a
I20260807 10:42:56.756186 14987 ts_tablet_manager.cc:1939] T 72b32f396e7348f38542645226a03a6a P e47173c962324e9d89bc83f9b829af3b: Deleting consensus metadata
I20260807 10:42:56.757007 14529 tablet_service.cc:1467] Processing CreateTablet for tablet aeee75f451f448b39572c8bae8d915a3 (DEFAULT_TABLE table=test-table [id=c71858b2b99f4ec0a21477765e70adf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:56.757272 14740 tablet_service.cc:1467] Processing CreateTablet for tablet aeee75f451f448b39572c8bae8d915a3 (DEFAULT_TABLE table=test-table [id=c71858b2b99f4ec0a21477765e70adf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:56.757517 14529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aeee75f451f448b39572c8bae8d915a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:56.757606 14324 tablet_service.cc:1467] Processing CreateTablet for tablet aeee75f451f448b39572c8bae8d915a3 (DEFAULT_TABLE table=test-table [id=c71858b2b99f4ec0a21477765e70adf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:42:56.757838 14740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aeee75f451f448b39572c8bae8d915a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:56.758075 14324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aeee75f451f448b39572c8bae8d915a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:42:56.764266 15009 tablet_bootstrap.cc:492] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697: Bootstrap starting.
I20260807 10:42:56.764298 15005 tablet_bootstrap.cc:492] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b: Bootstrap starting.
I20260807 10:42:56.765304 15008 tablet_bootstrap.cc:492] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045: Bootstrap starting.
I20260807 10:42:56.766086 15005 tablet_bootstrap.cc:654] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:56.766116 15009 tablet_bootstrap.cc:654] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:56.767110 15008 tablet_bootstrap.cc:654] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045: Neither blocks nor log segments found. Creating new log.
I20260807 10:42:56.770284 15008 tablet_bootstrap.cc:492] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045: No bootstrap required, opened a new log
I20260807 10:42:56.770502 15008 ts_tablet_manager.cc:1397] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 10:42:56.771111 14102 catalog_manager.cc:4841] TS e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811): tablet 72b32f396e7348f38542645226a03a6a (table test-table [id=055e66b3c68d4f449d98a6b2461815cf]) successfully deleted
I20260807 10:42:56.771358 15008 raft_consensus.cc:348] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.771654 15008 raft_consensus.cc:374] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:56.771750 15008 raft_consensus.cc:729] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de3dda642db423189b4313bda42a045, State: Initialized, Role: FOLLOWER
I20260807 10:42:56.772063 15008 consensus_queue.cc:260] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.774524 15008 ts_tablet_manager.cc:1428] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260807 10:42:56.774986 15009 tablet_bootstrap.cc:492] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697: No bootstrap required, opened a new log
I20260807 10:42:56.775187 15009 ts_tablet_manager.cc:1397] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260807 10:42:56.776144 15005 tablet_bootstrap.cc:492] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b: No bootstrap required, opened a new log
I20260807 10:42:56.776419 15005 ts_tablet_manager.cc:1397] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.004s
I20260807 10:42:56.776747 15009 raft_consensus.cc:348] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.777025 15009 raft_consensus.cc:374] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:56.777122 15009 raft_consensus.cc:729] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e87ecd1b20424db49bf7e7b44ad9d697, State: Initialized, Role: FOLLOWER
I20260807 10:42:56.777380 15009 consensus_queue.cc:260] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.777563 15005 raft_consensus.cc:348] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.777972 15005 raft_consensus.cc:374] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:42:56.778110 15005 raft_consensus.cc:729] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47173c962324e9d89bc83f9b829af3b, State: Initialized, Role: FOLLOWER
I20260807 10:42:56.778724 15009 ts_tablet_manager.cc:1428] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 10:42:56.778628 15005 consensus_queue.cc:260] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.779331 15005 ts_tablet_manager.cc:1428] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 10:42:56.910720 15037 raft_consensus.cc:482] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:42:56.910966 15037 raft_consensus.cc:504] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.911806 15037 leader_election.cc:288] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811), e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227)
I20260807 10:42:56.912477 14561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aeee75f451f448b39572c8bae8d915a3" candidate_uuid: "7de3dda642db423189b4313bda42a045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47173c962324e9d89bc83f9b829af3b" is_pre_election: true
I20260807 10:42:56.912547 14770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aeee75f451f448b39572c8bae8d915a3" candidate_uuid: "7de3dda642db423189b4313bda42a045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" is_pre_election: true
I20260807 10:42:56.912806 14770 raft_consensus.cc:2454] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de3dda642db423189b4313bda42a045 in term 0.
I20260807 10:42:56.912791 14561 raft_consensus.cc:2454] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7de3dda642db423189b4313bda42a045 in term 0.
I20260807 10:42:56.913292 14249 leader_election.cc:302] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de3dda642db423189b4313bda42a045, e87ecd1b20424db49bf7e7b44ad9d697; no voters:
I20260807 10:42:56.913646 15037 raft_consensus.cc:2781] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:42:56.913793 15037 raft_consensus.cc:482] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:42:56.913897 15037 raft_consensus.cc:3037] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:56.917249 15037 raft_consensus.cc:504] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.918126 15037 leader_election.cc:288] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [CANDIDATE]: Term 1 election: Requested vote from peers e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811), e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227)
I20260807 10:42:56.918903 14770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aeee75f451f448b39572c8bae8d915a3" candidate_uuid: "7de3dda642db423189b4313bda42a045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e87ecd1b20424db49bf7e7b44ad9d697"
I20260807 10:42:56.918934 14561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aeee75f451f448b39572c8bae8d915a3" candidate_uuid: "7de3dda642db423189b4313bda42a045" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47173c962324e9d89bc83f9b829af3b"
I20260807 10:42:56.919147 14770 raft_consensus.cc:3037] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:56.919157 14561 raft_consensus.cc:3037] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:42:56.921271 14770 raft_consensus.cc:2454] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de3dda642db423189b4313bda42a045 in term 1.
I20260807 10:42:56.921828 14249 leader_election.cc:302] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7de3dda642db423189b4313bda42a045, e87ecd1b20424db49bf7e7b44ad9d697; no voters:
I20260807 10:42:56.922160 15037 raft_consensus.cc:2781] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:42:56.922334 15037 raft_consensus.cc:686] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 1 LEADER]: Becoming Leader. State: Replica: 7de3dda642db423189b4313bda42a045, State: Running, Role: LEADER
I20260807 10:42:56.922298 14561 raft_consensus.cc:2454] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7de3dda642db423189b4313bda42a045 in term 1.
I20260807 10:42:56.922632 15037 consensus_queue.cc:237] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } }
I20260807 10:42:56.925920 14120 catalog_manager.cc:5495] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7de3dda642db423189b4313bda42a045 (127.11.46.129). New cstate: current_term: 1 leader_uuid: "7de3dda642db423189b4313bda42a045" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7de3dda642db423189b4313bda42a045" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 } health_report { overall_health: UNKNOWN } } }
I20260807 10:42:56.991123 14561 raft_consensus.cc:1261] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Refusing update from remote peer 7de3dda642db423189b4313bda42a045: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:56.991123 14770 raft_consensus.cc:1261] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Refusing update from remote peer 7de3dda642db423189b4313bda42a045: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:42:56.991838 15015 consensus_queue.cc:1035] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47173c962324e9d89bc83f9b829af3b" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:56.992270 15026 consensus_queue.cc:1035] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e87ecd1b20424db49bf7e7b44ad9d697" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:42:56.997676 14968 mvcc.cc:205] Tried to move back new op lower bound from 7315863048149786624 to 7315863047878062080. Current Snapshot: MvccSnapshot[applied={T|T < 7315863048149786624}]
W20260807 10:42:57.024375 14968 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 10:42:58.629968 14120 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:58.630276 14120 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58434:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:42:58.635143 14120 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e1c2b50c58c84c1ebfda617a21cc25d8: Sending DeleteTablet for 3 replicas of tablet aeee75f451f448b39572c8bae8d915a3
I20260807 10:42:58.636238 14529 tablet_service.cc:1514] Processing DeleteTablet for tablet aeee75f451f448b39572c8bae8d915a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:58 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:49024
I20260807 10:42:58.636298 14324 tablet_service.cc:1514] Processing DeleteTablet for tablet aeee75f451f448b39572c8bae8d915a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:58 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:33456
I20260807 10:42:58.636766 14740 tablet_service.cc:1514] Processing DeleteTablet for tablet aeee75f451f448b39572c8bae8d915a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:42:58 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:56130
I20260807 10:42:58.637483 15083 tablet_replica.cc:330] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045: stopping tablet replica
I20260807 10:42:58.637610 15085 tablet_replica.cc:330] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b: stopping tablet replica
I20260807 10:42:58.637713 15083 raft_consensus.cc:2229] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:42:58.637794 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 14227
I20260807 10:42:58.637964 15085 raft_consensus.cc:2229] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:58.638167 15083 raft_consensus.cc:2258] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:58.638353 15085 raft_consensus.cc:2258] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:58.638850 15086 tablet_replica.cc:330] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697: stopping tablet replica
I20260807 10:42:58.639081 15086 raft_consensus.cc:2229] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:42:58.639386 15086 raft_consensus.cc:2258] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:42:58.639922 15085 ts_tablet_manager.cc:1905] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:58.640431 15083 ts_tablet_manager.cc:1905] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:58.640736 15086 ts_tablet_manager.cc:1905] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:42:58.647722 15083 ts_tablet_manager.cc:1918] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:42:58.647722 15086 ts_tablet_manager.cc:1918] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:42:58.647912 15086 log.cc:1196] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/aeee75f451f448b39572c8bae8d915a3
I20260807 10:42:58.647941 15083 log.cc:1196] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/aeee75f451f448b39572c8bae8d915a3
I20260807 10:42:58.648411 15086 ts_tablet_manager.cc:1939] T aeee75f451f448b39572c8bae8d915a3 P e87ecd1b20424db49bf7e7b44ad9d697: Deleting consensus metadata
I20260807 10:42:58.648411 15083 ts_tablet_manager.cc:1939] T aeee75f451f448b39572c8bae8d915a3 P 7de3dda642db423189b4313bda42a045: Deleting consensus metadata
I20260807 10:42:58.648382 15085 ts_tablet_manager.cc:1918] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 10:42:58.648686 15085 log.cc:1196] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/aeee75f451f448b39572c8bae8d915a3
I20260807 10:42:58.649268 15085 ts_tablet_manager.cc:1939] T aeee75f451f448b39572c8bae8d915a3 P e47173c962324e9d89bc83f9b829af3b: Deleting consensus metadata
I20260807 10:42:58.649854 14101 catalog_manager.cc:4841] TS 7de3dda642db423189b4313bda42a045 (127.11.46.129:33215): tablet aeee75f451f448b39572c8bae8d915a3 (table test-table [id=c71858b2b99f4ec0a21477765e70adf8]) successfully deleted
I20260807 10:42:58.650341 14101 catalog_manager.cc:4841] TS e87ecd1b20424db49bf7e7b44ad9d697 (127.11.46.131:44227): tablet aeee75f451f448b39572c8bae8d915a3 (table test-table [id=c71858b2b99f4ec0a21477765e70adf8]) successfully deleted
I20260807 10:42:58.650839 14102 catalog_manager.cc:4841] TS e47173c962324e9d89bc83f9b829af3b (127.11.46.130:35811): tablet aeee75f451f448b39572c8bae8d915a3 (table test-table [id=c71858b2b99f4ec0a21477765e70adf8]) successfully deleted
Aug 07 10:42:58 dist-test-slave-42z9 krb5kdc[14050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099376, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:42:58.668677 15089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:58.639010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33474 (local address 127.11.46.129:33215)
0807 10:42:58.639896 (+ 886us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:58.639902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:58.650669 (+ 10767us) server_negotiation.cc:407] Connection header received
0807 10:42:58.650863 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:58.650867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:58.650944 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:58.651057 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:58.652610 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:58.653405 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:58.654764 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:58.655227 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:58.655336 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:58.662448 (+ 7112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:58.662471 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:58.662492 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:58.662544 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:58.665652 (+ 3108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:58.666460 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:58.666469 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:58.666471 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:58.666655 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:58.667112 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:58.667116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:58.667119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:58.667546 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:58.667787 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:58.668086 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 10:42:58.668286 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":761,"thread_start_us":669,"threads_started":1}
W20260807 10:42:58.669533 14421 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33474
W20260807 10:42:58.670226 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 14227: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:42:58.670480 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 14227
I20260807 10:42:58.712788 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 14438
Aug 07 10:42:58 dist-test-slave-42z9 krb5kdc[14050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099376, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:42:58.731050 15091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:58.713658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49034 (local address 127.11.46.130:35811)
0807 10:42:58.714211 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:58.714216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:58.714234 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:42:58.714295 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:58.714299 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:58.714366 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:58.714462 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:58.716432 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:58.717268 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:58.718902 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:58.719371 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:58.719474 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:58.724353 (+ 4879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:58.724374 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:58.724395 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:58.724443 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:58.727751 (+ 3308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:58.728650 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:58.728659 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:58.728662 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:58.728856 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:58.729280 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:58.729284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:58.729286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:58.729803 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:58.730080 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:58.730443 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 10:42:58.730680 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":282,"threads_started":1}
W20260807 10:42:58.731913 14623 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49034
W20260807 10:42:58.732661 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 14438: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:42:58.732812 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 14438
I20260807 10:42:58.773250 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 14642
Aug 07 10:42:58 dist-test-slave-42z9 krb5kdc[14050](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099376, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:42:58.795868 15093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:42:58.776387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56154 (local address 127.11.46.131:44227)
0807 10:42:58.776934 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0807 10:42:58.776941 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:42:58.776968 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:42:58.777051 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:42:58.777056 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:42:58.777145 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:42:58.777278 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:42:58.779394 (+ 2116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:58.780512 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:58.781989 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:42:58.782528 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:42:58.782658 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:42:58.787836 (+ 5178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:42:58.787862 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:42:58.787886 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:42:58.787940 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:42:58.791883 (+ 3943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:58.792819 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:58.792831 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:58.792834 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:58.793064 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:42:58.793498 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:42:58.793505 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:42:58.793508 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:42:58.794076 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:42:58.794454 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0807 10:42:58.795137 (+ 683us) server_negotiation.cc:299] Negotiation successful
0807 10:42:58.795434 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":242,"threads_started":1}
W20260807 10:42:58.796705 14841 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56154
W20260807 10:42:58.797463 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 14642: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:42:58.797683 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 14642
I20260807 10:42:58.846839 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 14070
I20260807 10:42:58.848161 14180 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:42:58.976233 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 14070
2026-08-07T10:42:59Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9274 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:42:59 dist-test-slave-42z9 krb5kdc[15101](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:42:59 dist-test-slave-42z9 krb5kdc[15101](info): set up 2 sockets
Aug 07 10:42:59 dist-test-slave-42z9 krb5kdc[15101](info): commencing operation
krb5kdc: starting...
W20260807 10:43:00.206315 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.002s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:43:00 dist-test-slave-42z9 krb5kdc[15101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099380, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:43:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:43:00.486006 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36787
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:36787
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:00.870173 15117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:00.870541 15117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:00.870649 15117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:00.878335 15117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:00.878476 15117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:00.878541 15117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:00.878602 15117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:00.878648 15117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:00.889276 15117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:36787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:00.890833 15117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:00.892241 15117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:00.905400 15124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:00.905479 15123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:00.905512 15128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:00.905725 15117 server_base.cc:1034] running on GCE node
I20260807 10:43:00.907189 15117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:00.908820 15117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:00.910064 15117 hybrid_clock.cc:648] HybridClock initialized: now 1786099380910010 us; error 47 us; skew 500 ppm
I20260807 10:43:00.910456 15117 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:00 dist-test-slave-42z9 krb5kdc[15101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099380, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:00.913956 15117 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:43:00.915622 15117 webserver.cc:460] Webserver started at http://127.11.46.190:42401/ using document root <none> and password file <none>
I20260807 10:43:00.916392 15117 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:00.916505 15117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:00.916813 15117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:00.920150 15117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "634f6130bb2545d0a08bfb759651f30a"
format_stamp: "Formatted at 2026-08-07 10:43:00 on dist-test-slave-42z9"
server_key: "3fc9ed32676807e2dffd6d37a79f3dab"
server_key_iv: "9d23ff60df69ec3d569a2b787eb41fa7"
server_key_version: "encryptionkey@0"
I20260807 10:43:00.920969 15117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "634f6130bb2545d0a08bfb759651f30a"
format_stamp: "Formatted at 2026-08-07 10:43:00 on dist-test-slave-42z9"
server_key: "3fc9ed32676807e2dffd6d37a79f3dab"
server_key_iv: "9d23ff60df69ec3d569a2b787eb41fa7"
server_key_version: "encryptionkey@0"
I20260807 10:43:00.927929 15117 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260807 10:43:00.932147 15136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:00.933945 15117 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:00.934175 15117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "634f6130bb2545d0a08bfb759651f30a"
format_stamp: "Formatted at 2026-08-07 10:43:00 on dist-test-slave-42z9"
server_key: "3fc9ed32676807e2dffd6d37a79f3dab"
server_key_iv: "9d23ff60df69ec3d569a2b787eb41fa7"
server_key_version: "encryptionkey@0"
I20260807 10:43:00.934418 15117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:00.947813 15117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:00.952747 15117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:00.953066 15117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:00.971797 15117 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:36787
I20260807 10:43:00.971819 15214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:36787 every 8 connection(s)
I20260807 10:43:00.973351 15117 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:00.973932 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 15117
I20260807 10:43:00.974191 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:00.975046 11450 external_mini_cluster.cc:1428] Setting key 15e3c7184d422dc8f5d7471d8db51781
I20260807 10:43:00.978575 15216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:43:00 dist-test-slave-42z9 krb5kdc[15101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099380, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:00.992990 15216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a: Bootstrap starting.
I20260807 10:43:00.997107 15216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:00.998442 15216 log.cc:824] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:01.000970 15221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:00.977431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42472 (local address 127.11.46.190:36787)
0807 10:43:00.978333 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:00.978346 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:00.978402 (+ 56us) server_negotiation.cc:407] Connection header received
0807 10:43:00.980239 (+ 1837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:00.980267 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:00.980714 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:00.981089 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:00.983067 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:00.984536 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:00.986469 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:00.987233 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:00.987422 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:00.992323 (+ 4901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:00.992334 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:00.992353 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:00.992428 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:00.995944 (+ 3516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:00.996877 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:00.996886 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:00.996894 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:00.997122 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:00.997668 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:00.997672 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:00.997674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:00.998349 (+ 675us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:00.998696 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:00.999260 (+ 564us) server_negotiation.cc:299] Negotiation successful
0807 10:43:00.999806 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":368,"threads_started":1}
I20260807 10:43:01.002153 15216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a: No bootstrap required, opened a new log
I20260807 10:43:01.010706 15216 raft_consensus.cc:348] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634f6130bb2545d0a08bfb759651f30a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36787 } }
I20260807 10:43:01.011242 15216 raft_consensus.cc:374] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:01.011359 15216 raft_consensus.cc:729] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 634f6130bb2545d0a08bfb759651f30a, State: Initialized, Role: FOLLOWER
I20260807 10:43:01.012038 15216 consensus_queue.cc:260] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634f6130bb2545d0a08bfb759651f30a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36787 } }
I20260807 10:43:01.012291 15216 raft_consensus.cc:388] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:01.012434 15216 raft_consensus.cc:482] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:01.012636 15216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:01.015029 15216 raft_consensus.cc:504] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634f6130bb2545d0a08bfb759651f30a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36787 } }
I20260807 10:43:01.015654 15216 leader_election.cc:302] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 634f6130bb2545d0a08bfb759651f30a; no voters:
I20260807 10:43:01.016299 15216 leader_election.cc:288] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:01.016523 15223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:01.017760 15223 raft_consensus.cc:686] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [term 1 LEADER]: Becoming Leader. State: Replica: 634f6130bb2545d0a08bfb759651f30a, State: Running, Role: LEADER
I20260807 10:43:01.018388 15223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634f6130bb2545d0a08bfb759651f30a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36787 } }
I20260807 10:43:01.018850 15216 sys_catalog.cc:564] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:01.021941 15225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 634f6130bb2545d0a08bfb759651f30a. Latest consensus state: current_term: 1 leader_uuid: "634f6130bb2545d0a08bfb759651f30a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634f6130bb2545d0a08bfb759651f30a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36787 } } }
I20260807 10:43:01.021899 15224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "634f6130bb2545d0a08bfb759651f30a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "634f6130bb2545d0a08bfb759651f30a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36787 } } }
I20260807 10:43:01.022399 15225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:01.022405 15224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:01.024513 15236 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:01.029381 15236 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:01.039163 15236 catalog_manager.cc:1347] Generated new cluster ID: b855b75c91584921bfcc8d43548d787c
I20260807 10:43:01.039335 15236 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:01.075984 15236 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:01.077399 15236 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:01.096282 15236 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 634f6130bb2545d0a08bfb759651f30a: Generated new TSK 0
I20260807 10:43:01.097261 15236 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:43:01.164520 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36787
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:01.538316 15252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:01.538684 15252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:01.538834 15252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:01.546572 15252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:01.546716 15252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:01.546875 15252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:01.557308 15252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36787
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:01.558797 15252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:01.560247 15252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:01.574894 15257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:01.574988 15258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:01.574922 15262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:01.579093 15252 server_base.cc:1034] running on GCE node
I20260807 10:43:01.579908 15252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:01.581048 15252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:01.582278 15252 hybrid_clock.cc:648] HybridClock initialized: now 1786099381582205 us; error 68 us; skew 500 ppm
I20260807 10:43:01.582659 15252 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:01 dist-test-slave-42z9 krb5kdc[15101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099381, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:01.586321 15252 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:43:01.588248 15252 webserver.cc:460] Webserver started at http://127.11.46.129:43259/ using document root <none> and password file <none>
I20260807 10:43:01.589157 15252 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:01.589293 15252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:01.589717 15252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:01.593137 15252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "88aa303ae52042d19bd9fc66882ed2fb"
format_stamp: "Formatted at 2026-08-07 10:43:01 on dist-test-slave-42z9"
server_key: "531e86540cb54ade85a211f88f3a4412"
server_key_iv: "9fb2857dbf1975da5294bd8feabb1e8a"
server_key_version: "encryptionkey@0"
I20260807 10:43:01.594177 15252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "88aa303ae52042d19bd9fc66882ed2fb"
format_stamp: "Formatted at 2026-08-07 10:43:01 on dist-test-slave-42z9"
server_key: "531e86540cb54ade85a211f88f3a4412"
server_key_iv: "9fb2857dbf1975da5294bd8feabb1e8a"
server_key_version: "encryptionkey@0"
I20260807 10:43:01.600762 15252 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:43:01.605492 15274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:01.607247 15252 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:01.607483 15252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "88aa303ae52042d19bd9fc66882ed2fb"
format_stamp: "Formatted at 2026-08-07 10:43:01 on dist-test-slave-42z9"
server_key: "531e86540cb54ade85a211f88f3a4412"
server_key_iv: "9fb2857dbf1975da5294bd8feabb1e8a"
server_key_version: "encryptionkey@0"
I20260807 10:43:01.607744 15252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:01.641700 15252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:01.646649 15252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:01.646972 15252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:01.648125 15252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:01.649770 15252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:01.649855 15252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:01.650005 15252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:01.650061 15252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:01.685799 15252 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:41199
I20260807 10:43:01.685819 15442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:41199 every 8 connection(s)
I20260807 10:43:01.687230 15252 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:01.694029 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 15252
I20260807 10:43:01.694301 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:43:01.695113 11450 external_mini_cluster.cc:1428] Setting key 7934ac7e269f60f4af883bd2a5106e38
Aug 07 10:43:01 dist-test-slave-42z9 krb5kdc[15101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099381, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:01.710764 15445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:01.690009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:53911 (local address 127.11.46.190:36787)
0807 10:43:01.690480 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:01.690485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:01.691575 (+ 1090us) server_negotiation.cc:407] Connection header received
0807 10:43:01.693626 (+ 2051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:01.693631 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:01.693714 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:01.693814 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:01.696131 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:01.696889 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:01.699297 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:01.699750 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:01.699855 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:01.704319 (+ 4464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:01.704325 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:01.704329 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:01.704367 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:01.707094 (+ 2727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:01.708082 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:01.708090 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:01.708093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:01.708267 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:01.708724 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:01.708730 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:01.708733 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:01.709120 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:01.709286 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:01.710126 (+ 840us) server_negotiation.cc:299] Negotiation successful
0807 10:43:01.710386 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":247,"threads_started":1}
I20260807 10:43:01.711659 15446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:01.690570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36787 (local address 127.11.46.129:53911)
0807 10:43:01.691375 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:01.691417 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:01.693279 (+ 1862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:01.694144 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:01.694158 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:01.695011 (+ 853us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:01.695922 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:01.695947 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:01.697088 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:01.697093 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:01.699124 (+ 2031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:01.699143 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:01.700019 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:01.700027 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:01.700344 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:01.701133 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:01.701171 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:01.704031 (+ 2860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:01.707288 (+ 3257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:01.707298 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:01.707321 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:01.707925 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:01.708373 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:01.708376 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:01.708379 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:01.708606 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:01.709239 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:01.709245 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:01.709680 (+ 435us) client_negotiation.cc:769] Sending connection context
0807 10:43:01.709962 (+ 282us) client_negotiation.cc:240] Negotiation successful
0807 10:43:01.710400 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":321,"threads_started":1}
I20260807 10:43:01.713361 15443 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36787
I20260807 10:43:01.713852 15443 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:01.714869 15443 heartbeater.cc:511] Master 127.11.46.190:36787 requested a full tablet report, sending...
I20260807 10:43:01.717495 15162 ts_manager.cc:194] Registered new tserver with Master: 88aa303ae52042d19bd9fc66882ed2fb (127.11.46.129:41199)
I20260807 10:43:01.719225 15162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:53911
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:43:01.752956 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36787
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:02.143332 15453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:02.143678 15453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:02.143810 15453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:02.152284 15453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:02.152478 15453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:02.152683 15453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:02.165159 15453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36787
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:02.168113 15453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:02.170140 15453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:02.187764 15464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:02.187865 15467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:02.187837 15463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:02.188843 15453 server_base.cc:1034] running on GCE node
I20260807 10:43:02.189675 15453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:02.190804 15453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:02.192049 15453 hybrid_clock.cc:648] HybridClock initialized: now 1786099382191989 us; error 54 us; skew 500 ppm
I20260807 10:43:02.192417 15453 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:02 dist-test-slave-42z9 krb5kdc[15101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099382, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:02.195942 15453 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:43:02.197834 15453 webserver.cc:460] Webserver started at http://127.11.46.130:37435/ using document root <none> and password file <none>
I20260807 10:43:02.198652 15453 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:02.198776 15453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:02.199100 15453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:02.202654 15453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "840176d235ac44e3bede89664624f8bd"
format_stamp: "Formatted at 2026-08-07 10:43:02 on dist-test-slave-42z9"
server_key: "662caaa01e88d5c6224e58929ff040b8"
server_key_iv: "f243de06b710d00f5b1dea0086b0072b"
server_key_version: "encryptionkey@0"
I20260807 10:43:02.203541 15453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "840176d235ac44e3bede89664624f8bd"
format_stamp: "Formatted at 2026-08-07 10:43:02 on dist-test-slave-42z9"
server_key: "662caaa01e88d5c6224e58929ff040b8"
server_key_iv: "f243de06b710d00f5b1dea0086b0072b"
server_key_version: "encryptionkey@0"
I20260807 10:43:02.209972 15453 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:43:02.214658 15475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:02.216336 15453 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:43:02.216543 15453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "840176d235ac44e3bede89664624f8bd"
format_stamp: "Formatted at 2026-08-07 10:43:02 on dist-test-slave-42z9"
server_key: "662caaa01e88d5c6224e58929ff040b8"
server_key_iv: "f243de06b710d00f5b1dea0086b0072b"
server_key_version: "encryptionkey@0"
I20260807 10:43:02.216802 15453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:02.248759 15453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:02.253368 15453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:02.253727 15453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:02.254833 15453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:02.256450 15453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:02.256538 15453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:02.256675 15453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:02.256722 15453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:02.291656 15453 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:38035
I20260807 10:43:02.291711 15650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:38035 every 8 connection(s)
I20260807 10:43:02.293144 15453 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:02.301286 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 15453
I20260807 10:43:02.301527 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:43:02.302163 11450 external_mini_cluster.cc:1428] Setting key 4c06808a34a2ffec086472b8b5da6a92
Aug 07 10:43:02 dist-test-slave-42z9 krb5kdc[15101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099382, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:02.315896 15653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:02.295972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:47567 (local address 127.11.46.190:36787)
0807 10:43:02.296495 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:02.296501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:02.297536 (+ 1035us) server_negotiation.cc:407] Connection header received
0807 10:43:02.299534 (+ 1998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:02.299539 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:02.299617 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:02.299717 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:02.301509 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:02.302640 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:02.304647 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:02.305303 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:02.305463 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:02.309387 (+ 3924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:02.309393 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:02.309397 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:02.309435 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:02.312218 (+ 2783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:02.313198 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:02.313202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:02.313205 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:02.313340 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:02.313873 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:02.313879 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:02.313881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:02.314306 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:02.314465 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:02.315285 (+ 820us) server_negotiation.cc:299] Negotiation successful
0807 10:43:02.315534 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":240,"threads_started":1}
I20260807 10:43:02.316841 15656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:02.296593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36787 (local address 127.11.46.130:47567)
0807 10:43:02.297336 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:02.297393 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:02.299211 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:02.299968 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:02.299977 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:02.300560 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:02.301224 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:02.301244 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:02.302882 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:02.302889 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:02.304485 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:02.304501 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:02.305572 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:02.305587 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:02.305813 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:02.306514 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:02.306547 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:02.309090 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:02.312397 (+ 3307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:02.312407 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:02.312426 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:02.313059 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:02.313465 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:02.313469 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:02.313472 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:02.313741 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:02.314454 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:02.314460 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:02.314849 (+ 389us) client_negotiation.cc:769] Sending connection context
0807 10:43:02.315103 (+ 254us) client_negotiation.cc:240] Negotiation successful
0807 10:43:02.315592 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":298,"threads_started":1}
I20260807 10:43:02.318481 15651 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36787
I20260807 10:43:02.318809 15651 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:02.319696 15651 heartbeater.cc:511] Master 127.11.46.190:36787 requested a full tablet report, sending...
I20260807 10:43:02.321530 15162 ts_manager.cc:194] Registered new tserver with Master: 840176d235ac44e3bede89664624f8bd (127.11.46.130:38035)
I20260807 10:43:02.322466 15162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:47567
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:43:02.358295 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36787
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:43:02.723404 15443 heartbeater.cc:503] Master 127.11.46.190:36787 was elected leader, sending a full tablet report...
W20260807 10:43:02.724848 15660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:02.725317 15660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:02.725518 15660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:02.733592 15660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:02.733739 15660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:02.733899 15660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:02.744707 15660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36787
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:02.746225 15660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:02.747714 15660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:02.761787 15667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:02.761889 15669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:02.761824 15673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:02.762749 15660 server_base.cc:1034] running on GCE node
I20260807 10:43:02.763463 15660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:02.764503 15660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:02.765712 15660 hybrid_clock.cc:648] HybridClock initialized: now 1786099382765654 us; error 51 us; skew 500 ppm
I20260807 10:43:02.766029 15660 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:02 dist-test-slave-42z9 krb5kdc[15101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099382, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:02.769377 15660 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:43:02.771090 15660 webserver.cc:460] Webserver started at http://127.11.46.131:41315/ using document root <none> and password file <none>
I20260807 10:43:02.771836 15660 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:02.771956 15660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:02.772310 15660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:02.775555 15660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "8c4f9a43210f4bec8c57e140508d11eb"
format_stamp: "Formatted at 2026-08-07 10:43:02 on dist-test-slave-42z9"
server_key: "1d186f7e9b02521441ad229ebfffe55d"
server_key_iv: "0e3503d932e2979bc0b2c372d3245f25"
server_key_version: "encryptionkey@0"
I20260807 10:43:02.776393 15660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "8c4f9a43210f4bec8c57e140508d11eb"
format_stamp: "Formatted at 2026-08-07 10:43:02 on dist-test-slave-42z9"
server_key: "1d186f7e9b02521441ad229ebfffe55d"
server_key_iv: "0e3503d932e2979bc0b2c372d3245f25"
server_key_version: "encryptionkey@0"
I20260807 10:43:02.782137 15660 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260807 10:43:02.785931 15684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:02.787384 15660 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:43:02.787568 15660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "8c4f9a43210f4bec8c57e140508d11eb"
format_stamp: "Formatted at 2026-08-07 10:43:02 on dist-test-slave-42z9"
server_key: "1d186f7e9b02521441ad229ebfffe55d"
server_key_iv: "0e3503d932e2979bc0b2c372d3245f25"
server_key_version: "encryptionkey@0"
I20260807 10:43:02.787778 15660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:02.812983 15660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:02.818126 15660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:02.818451 15660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:02.819612 15660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:02.821236 15660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:02.821345 15660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:02.821542 15660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:02.821615 15660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:02.855657 15660 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:46303
I20260807 10:43:02.855710 15853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:46303 every 8 connection(s)
I20260807 10:43:02.857151 15660 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:02.864197 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 15660
I20260807 10:43:02.864449 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:43:02.865078 11450 external_mini_cluster.cc:1428] Setting key 37324554b128783e6b8708b495d5cf77
Aug 07 10:43:02 dist-test-slave-42z9 krb5kdc[15101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099382, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:02.879832 15856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:02.859992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:39829 (local address 127.11.46.190:36787)
0807 10:43:02.860482 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:02.860489 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:02.861698 (+ 1209us) server_negotiation.cc:407] Connection header received
0807 10:43:02.863751 (+ 2053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:02.863756 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:02.863838 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:02.863928 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:02.866371 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:02.867467 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:02.869465 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:02.869893 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:02.870037 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:02.873843 (+ 3806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:02.873849 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:02.873852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:02.873893 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:02.876284 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:02.877137 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:02.877142 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:02.877144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:02.877281 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:02.877823 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:02.877827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:02.877829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:02.878145 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:02.878297 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:02.879192 (+ 895us) server_negotiation.cc:299] Negotiation successful
0807 10:43:02.879470 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":218,"threads_started":1}
I20260807 10:43:02.881138 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:02.860661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36787 (local address 127.11.46.131:39829)
0807 10:43:02.861513 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:02.861566 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:02.863395 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:02.864286 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:02.864300 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:02.865188 (+ 888us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:02.866142 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:02.866174 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:02.867671 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:02.867676 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:02.869256 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:02.869273 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:02.870174 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:02.870182 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:02.870454 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:02.871128 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:02.871154 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:02.873571 (+ 2417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:02.876463 (+ 2892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:02.876474 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:02.876490 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:02.876985 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:02.877408 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:02.877412 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:02.877415 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:02.877691 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:02.878301 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:02.878310 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:02.878717 (+ 407us) client_negotiation.cc:769] Sending connection context
0807 10:43:02.879035 (+ 318us) client_negotiation.cc:240] Negotiation successful
0807 10:43:02.879635 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":298,"threads_started":1}
I20260807 10:43:02.882566 15854 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36787
I20260807 10:43:02.882917 15854 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:02.883708 15854 heartbeater.cc:511] Master 127.11.46.190:36787 requested a full tablet report, sending...
I20260807 10:43:02.885232 15162 ts_manager.cc:194] Registered new tserver with Master: 8c4f9a43210f4bec8c57e140508d11eb (127.11.46.131:46303)
I20260807 10:43:02.886155 15162 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:39829
I20260807 10:43:02.894289 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 10:43:02.938935 15856 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:02.936181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42474 (local address 127.11.46.190:36787)
0807 10:43:02.936477 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:02.936484 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:02.936783 (+ 299us) server_negotiation.cc:407] Connection header received
0807 10:43:02.936997 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:02.937002 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:02.937105 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:02.937202 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:02.938722 (+ 1520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42474: BlockingRecv error: recv got EOF from 127.0.0.1:42474 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
I20260807 10:43:02.942545 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 15252
W20260807 10:43:02.945636 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 15252: Not authorized: Client connection negotiation failed: client connection to 127.11.46.129:41199: server requires authentication, but client does not have Kerberos credentials available
I20260807 10:43:02.945811 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 15252
I20260807 10:43:02.974970 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 15453
W20260807 10:43:02.979291 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 15453: Not authorized: Client connection negotiation failed: client connection to 127.11.46.130:38035: server requires authentication, but client does not have Kerberos credentials available
I20260807 10:43:02.979494 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 15453
I20260807 10:43:03.006826 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 15660
W20260807 10:43:03.010092 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 15660: Not authorized: Client connection negotiation failed: client connection to 127.11.46.131:46303: server requires authentication, but client does not have Kerberos credentials available
I20260807 10:43:03.010273 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 15660
I20260807 10:43:03.035861 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 15117
I20260807 10:43:03.037130 15209 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:03.146425 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 15117
2026-08-07T10:43:03Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4168 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:43:03 dist-test-slave-42z9 krb5kdc[15882](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:43:03 dist-test-slave-42z9 krb5kdc[15882](info): set up 2 sockets
Aug 07 10:43:03 dist-test-slave-42z9 krb5kdc[15882](info): commencing operation
krb5kdc: starting...
W20260807 10:43:04.366905 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:43:04 dist-test-slave-42z9 krb5kdc[15882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:43:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:43:04.626495 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:38959
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:42597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:38959
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:05.002637 15907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:05.002988 15907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:05.003093 15907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:05.010919 15907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:05.011065 15907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:05.011116 15907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:05.011176 15907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:05.011243 15907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:05.022120 15907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:42597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:38959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:38959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:05.023625 15907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:05.025081 15907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:05.038575 15912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:05.038512 15914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:05.038533 15916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:05.039769 15907 server_base.cc:1034] running on GCE node
I20260807 10:43:05.040792 15907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:05.042685 15907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:05.043901 15907 hybrid_clock.cc:648] HybridClock initialized: now 1786099385043847 us; error 66 us; skew 500 ppm
I20260807 10:43:05.044297 15907 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:05 dist-test-slave-42z9 krb5kdc[15882](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099385, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:05.052742 15907 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:43:05.054616 15907 webserver.cc:460] Webserver started at http://127.11.46.190:45665/ using document root <none> and password file <none>
I20260807 10:43:05.055410 15907 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:05.055543 15907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:05.055869 15907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:05.059285 15907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a"
format_stamp: "Formatted at 2026-08-07 10:43:05 on dist-test-slave-42z9"
server_key: "37997f07aaaae1eaae57a10bf589a50e"
server_key_iv: "135c7abbba567a20ea6a0958a7e97923"
server_key_version: "encryptionkey@0"
I20260807 10:43:05.060225 15907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a"
format_stamp: "Formatted at 2026-08-07 10:43:05 on dist-test-slave-42z9"
server_key: "37997f07aaaae1eaae57a10bf589a50e"
server_key_iv: "135c7abbba567a20ea6a0958a7e97923"
server_key_version: "encryptionkey@0"
I20260807 10:43:05.066242 15907 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 10:43:05.070278 15931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:05.071909 15907 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 10:43:05.072149 15907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a"
format_stamp: "Formatted at 2026-08-07 10:43:05 on dist-test-slave-42z9"
server_key: "37997f07aaaae1eaae57a10bf589a50e"
server_key_iv: "135c7abbba567a20ea6a0958a7e97923"
server_key_version: "encryptionkey@0"
I20260807 10:43:05.072388 15907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:05.104936 15907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:05.109266 15907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:05.109583 15907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:05.129159 15907 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:38959
I20260807 10:43:05.129204 16007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:38959 every 8 connection(s)
I20260807 10:43:05.130712 15907 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:05.134466 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 15907
I20260807 10:43:05.134704 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:05.135202 16011 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:05.135571 11450 external_mini_cluster.cc:1428] Setting key 1db3552d8080cbc0847d8b21dfa38f24
I20260807 10:43:05.151109 16011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a: Bootstrap starting.
Aug 07 10:43:05 dist-test-slave-42z9 krb5kdc[15882](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:05.155822 16011 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:05.157598 16011 log.cc:824] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:05.161509 16011 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a: No bootstrap required, opened a new log
I20260807 10:43:05.162767 16014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:05.137866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54658 (local address 127.11.46.190:38959)
0807 10:43:05.138924 (+ 1058us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:05.138941 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:05.138996 (+ 55us) server_negotiation.cc:407] Connection header received
0807 10:43:05.140813 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:05.140846 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:05.141323 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:05.141766 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:05.143720 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:05.145026 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:05.146719 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:05.147493 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:05.147646 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:05.153012 (+ 5366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:05.153030 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:05.153063 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:05.153136 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:05.157721 (+ 4585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:05.158823 (+ 1102us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:05.158835 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:05.158851 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:05.159129 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:05.159652 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:05.159656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:05.159659 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:05.160364 (+ 705us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:05.160632 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:05.161166 (+ 534us) server_negotiation.cc:299] Negotiation successful
0807 10:43:05.161650 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":807,"thread_start_us":442,"threads_started":1}
I20260807 10:43:05.167222 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:43:05.171499 16011 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38959 } }
I20260807 10:43:05.172109 16011 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:05.172221 16011 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bee94fa4ce94fdc9df8d26e3f0f671a, State: Initialized, Role: FOLLOWER
I20260807 10:43:05.172998 16011 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38959 } }
I20260807 10:43:05.173324 16011 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:05.173506 16011 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:05.173692 16011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:05.176152 16011 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38959 } }
I20260807 10:43:05.176806 16011 leader_election.cc:302] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8bee94fa4ce94fdc9df8d26e3f0f671a; no voters:
I20260807 10:43:05.177591 16011 leader_election.cc:288] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:05.177735 16019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:05.180543 16011 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:05.182894 16019 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [term 1 LEADER]: Becoming Leader. State: Replica: 8bee94fa4ce94fdc9df8d26e3f0f671a, State: Running, Role: LEADER
I20260807 10:43:05.183650 16019 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38959 } }
I20260807 10:43:05.186674 16020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38959 } } }
I20260807 10:43:05.186663 16021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bee94fa4ce94fdc9df8d26e3f0f671a. Latest consensus state: current_term: 1 leader_uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bee94fa4ce94fdc9df8d26e3f0f671a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38959 } } }
I20260807 10:43:05.187144 16021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:05.187144 16020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:05.196507 16034 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:05.202491 16034 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:05.214399 16034 catalog_manager.cc:1347] Generated new cluster ID: 06719919b68a473db5a56b5b07510cd0
I20260807 10:43:05.214556 16034 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:05.227192 16034 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:05.229120 16034 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:05.232882 16014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:05.222605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54660 (local address 127.11.46.190:38959)
0807 10:43:05.222864 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:05.222873 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:05.223458 (+ 585us) server_negotiation.cc:407] Connection header received
0807 10:43:05.223661 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:05.223665 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:05.223749 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:05.223845 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:05.225026 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:05.226215 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:05.228410 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:05.229132 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:05.229285 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:05.230851 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:05.230859 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:05.230863 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:05.231798 (+ 935us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:05.231867 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:05.231916 (+ 49us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:05.232059 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:05.232290 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 10:43:05.232453 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":80}
I20260807 10:43:05.237375 16034 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8bee94fa4ce94fdc9df8d26e3f0f671a: Generated new TSK 0
I20260807 10:43:05.238474 16034 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:43:05.248377 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 15907
I20260807 10:43:05.249876 16002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:05.341079 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 15907
2026-08-07T10:43:05Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2183 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:43:05 dist-test-slave-42z9 krb5kdc[16066](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:43:05 dist-test-slave-42z9 krb5kdc[16066](info): set up 2 sockets
Aug 07 10:43:05 dist-test-slave-42z9 krb5kdc[16066](info): commencing operation
krb5kdc: starting...
W20260807 10:43:06.551990 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.001s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:43:06 dist-test-slave-42z9 krb5kdc[16066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:43:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:43:06.814775 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:41825
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:41825
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:07.182675 16083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:07.183018 16083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:07.183199 16083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:07.191067 16083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:07.191201 16083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:07.191277 16083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:07.191372 16083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:07.191429 16083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:07.202337 16083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:41825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:41825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:07.203923 16083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:07.205428 16083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:07.218737 16089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:07.218709 16090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:07.218778 16093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:07.219959 16083 server_base.cc:1034] running on GCE node
I20260807 10:43:07.220911 16083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:07.222582 16083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:07.223814 16083 hybrid_clock.cc:648] HybridClock initialized: now 1786099387223755 us; error 42 us; skew 500 ppm
I20260807 10:43:07.224213 16083 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:07 dist-test-slave-42z9 krb5kdc[16066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:07.227789 16083 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:43:07.229668 16083 webserver.cc:460] Webserver started at http://127.11.46.190:35731/ using document root <none> and password file <none>
I20260807 10:43:07.230579 16083 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:07.230720 16083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:07.231069 16083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:07.234588 16083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "c0129eab276541bba01d170e80df0c38"
format_stamp: "Formatted at 2026-08-07 10:43:07 on dist-test-slave-42z9"
server_key: "ca67df42d3a790d91a83b26730335914"
server_key_iv: "8592f5a0824c26ebd99bf5142b7cb040"
server_key_version: "encryptionkey@0"
I20260807 10:43:07.235518 16083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "c0129eab276541bba01d170e80df0c38"
format_stamp: "Formatted at 2026-08-07 10:43:07 on dist-test-slave-42z9"
server_key: "ca67df42d3a790d91a83b26730335914"
server_key_iv: "8592f5a0824c26ebd99bf5142b7cb040"
server_key_version: "encryptionkey@0"
I20260807 10:43:07.242230 16083 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:43:07.246326 16107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:07.247927 16083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:43:07.248143 16083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "c0129eab276541bba01d170e80df0c38"
format_stamp: "Formatted at 2026-08-07 10:43:07 on dist-test-slave-42z9"
server_key: "ca67df42d3a790d91a83b26730335914"
server_key_iv: "8592f5a0824c26ebd99bf5142b7cb040"
server_key_version: "encryptionkey@0"
I20260807 10:43:07.248360 16083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:07.276765 16083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:07.281571 16083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:07.281880 16083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:07.301915 16083 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:41825
I20260807 10:43:07.301923 16182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:41825 every 8 connection(s)
I20260807 10:43:07.303453 16083 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:07.308130 16185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:07.312368 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 16083
I20260807 10:43:07.312618 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:07.313274 11450 external_mini_cluster.cc:1428] Setting key e04df568f98dbaf330a9984d1a19733e
I20260807 10:43:07.322836 16185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38: Bootstrap starting.
I20260807 10:43:07.327353 16185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:07.328951 16185 log.cc:824] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38: Log is configured to *not* fsync() on all Append() calls
Aug 07 10:43:07 dist-test-slave-42z9 krb5kdc[16066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:07.332810 16185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38: No bootstrap required, opened a new log
I20260807 10:43:07.339334 16189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:07.315672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33598 (local address 127.11.46.190:41825)
0807 10:43:07.316534 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:07.316547 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:07.316592 (+ 45us) server_negotiation.cc:407] Connection header received
0807 10:43:07.318317 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:07.318348 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:07.318824 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:07.319200 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:07.321086 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:07.322530 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:07.324335 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:07.325425 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:07.325621 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:07.330683 (+ 5062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:07.330693 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:07.330714 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:07.330767 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:07.334252 (+ 3485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:07.335186 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:07.335194 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:07.335204 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:07.335442 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:07.335914 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:07.335918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:07.335920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:07.336600 (+ 680us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:07.336958 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:07.337540 (+ 582us) server_negotiation.cc:299] Negotiation successful
0807 10:43:07.338090 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":404,"threads_started":1}
I20260807 10:43:07.341976 16185 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0129eab276541bba01d170e80df0c38" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41825 } }
I20260807 10:43:07.342483 16185 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:07.342612 16185 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0129eab276541bba01d170e80df0c38, State: Initialized, Role: FOLLOWER
I20260807 10:43:07.343314 16185 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0129eab276541bba01d170e80df0c38" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41825 } }
I20260807 10:43:07.343588 16185 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:07.343727 16185 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:07.343894 16185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:07.346446 16185 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0129eab276541bba01d170e80df0c38" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41825 } }
I20260807 10:43:07.347069 16185 leader_election.cc:302] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0129eab276541bba01d170e80df0c38; no voters:
I20260807 10:43:07.347744 16185 leader_election.cc:288] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:07.347901 16194 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:07.348632 16194 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [term 1 LEADER]: Becoming Leader. State: Replica: c0129eab276541bba01d170e80df0c38, State: Running, Role: LEADER
I20260807 10:43:07.349258 16194 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0129eab276541bba01d170e80df0c38" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41825 } }
I20260807 10:43:07.350553 16185 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:07.352769 16195 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0129eab276541bba01d170e80df0c38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0129eab276541bba01d170e80df0c38" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41825 } } }
I20260807 10:43:07.352838 16196 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0129eab276541bba01d170e80df0c38. Latest consensus state: current_term: 1 leader_uuid: "c0129eab276541bba01d170e80df0c38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0129eab276541bba01d170e80df0c38" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41825 } } }
I20260807 10:43:07.353216 16195 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:07.353277 16196 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:07.358287 16199 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:07.364952 16199 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:07.375785 16199 catalog_manager.cc:1347] Generated new cluster ID: c0e02fc86aef4bd99c79875f4f3b2003
I20260807 10:43:07.375929 16199 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:07.399072 16199 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:07.400719 16199 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:07.411095 16199 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0129eab276541bba01d170e80df0c38: Generated new TSK 0
I20260807 10:43:07.412138 16199 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:43:07.479211 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41825
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:07.866065 16222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:07.866461 16222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:07.866622 16222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:07.874599 16222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:07.874789 16222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:07.874959 16222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:07.885821 16222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:07.887390 16222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:07.888988 16222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:07.904628 16234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:07.904552 16230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:07.904565 16228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:07.905771 16222 server_base.cc:1034] running on GCE node
I20260807 10:43:07.906481 16222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:07.907640 16222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:07.908885 16222 hybrid_clock.cc:648] HybridClock initialized: now 1786099387908818 us; error 50 us; skew 500 ppm
I20260807 10:43:07.909289 16222 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:07 dist-test-slave-42z9 krb5kdc[16066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:07.913195 16222 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:43:07.915084 16222 webserver.cc:460] Webserver started at http://127.11.46.129:37667/ using document root <none> and password file <none>
I20260807 10:43:07.915923 16222 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:07.916050 16222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:07.916361 16222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:07.919862 16222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "6032dd84537a43c682592021a24f2e12"
format_stamp: "Formatted at 2026-08-07 10:43:07 on dist-test-slave-42z9"
server_key: "d883cba5966ba2fc9ecd12af329739ca"
server_key_iv: "894f31d9404ee84f78fe31479473da1c"
server_key_version: "encryptionkey@0"
I20260807 10:43:07.920783 16222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "6032dd84537a43c682592021a24f2e12"
format_stamp: "Formatted at 2026-08-07 10:43:07 on dist-test-slave-42z9"
server_key: "d883cba5966ba2fc9ecd12af329739ca"
server_key_iv: "894f31d9404ee84f78fe31479473da1c"
server_key_version: "encryptionkey@0"
I20260807 10:43:07.927533 16222 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:43:07.932238 16244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:07.933935 16222 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 10:43:07.934142 16222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "6032dd84537a43c682592021a24f2e12"
format_stamp: "Formatted at 2026-08-07 10:43:07 on dist-test-slave-42z9"
server_key: "d883cba5966ba2fc9ecd12af329739ca"
server_key_iv: "894f31d9404ee84f78fe31479473da1c"
server_key_version: "encryptionkey@0"
I20260807 10:43:07.934386 16222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:07.951313 16222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:07.956254 16222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:07.956565 16222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:07.957713 16222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:07.959369 16222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:07.959453 16222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:07.959569 16222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:07.959617 16222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:07.994993 16222 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:39883
I20260807 10:43:07.995026 16420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:39883 every 8 connection(s)
I20260807 10:43:07.996451 16222 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:07.999162 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 16222
I20260807 10:43:07.999415 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:43:08.000177 11450 external_mini_cluster.cc:1428] Setting key f2a9e18fbc4188d6b4e7388518bd13e0
Aug 07 10:43:08 dist-test-slave-42z9 krb5kdc[16066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:08.021615 16424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:07.999235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:45037 (local address 127.11.46.190:41825)
0807 10:43:07.999848 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:07.999855 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:08.001024 (+ 1169us) server_negotiation.cc:407] Connection header received
0807 10:43:08.003461 (+ 2437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:08.003468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:08.003554 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:08.003650 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:08.006063 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:08.006852 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:08.009287 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:08.009800 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:08.009916 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:08.014664 (+ 4748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:08.014673 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:08.014678 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:08.014736 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:08.017560 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:08.018729 (+ 1169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:08.018734 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:08.018736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:08.018891 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:08.019494 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:08.019498 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:08.019500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:08.019804 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:08.019935 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:08.021030 (+ 1095us) server_negotiation.cc:299] Negotiation successful
0807 10:43:08.021250 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":312,"threads_started":1}
I20260807 10:43:08.023218 16426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:07.999870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:41825 (local address 127.11.46.129:45037)
0807 10:43:08.000817 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:08.000887 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:08.003071 (+ 2184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:08.003978 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:08.003992 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:08.004822 (+ 830us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:08.005796 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:08.005826 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:08.007067 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:08.007072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:08.009058 (+ 1986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:08.009078 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:08.010087 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:08.010094 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:08.010428 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:08.011273 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:08.011309 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:08.014346 (+ 3037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:08.017785 (+ 3439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:08.017798 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:08.017822 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:08.018559 (+ 737us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:08.019020 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:08.019025 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:08.019030 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:08.019357 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:08.019966 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:08.019975 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:08.020539 (+ 564us) client_negotiation.cc:769] Sending connection context
0807 10:43:08.020894 (+ 355us) client_negotiation.cc:240] Negotiation successful
0807 10:43:08.021596 (+ 702us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":341,"threads_started":1}
I20260807 10:43:08.024981 16422 heartbeater.cc:347] Connected to a master server at 127.11.46.190:41825
I20260807 10:43:08.025390 16422 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:08.026523 16422 heartbeater.cc:511] Master 127.11.46.190:41825 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
I20260807 10:43:08.029277 16134 ts_manager.cc:194] Registered new tserver with Master: 6032dd84537a43c682592021a24f2e12 (127.11.46.129:39883)
I20260807 10:43:08.030997 16134 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:45037
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:43:08.062453 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41825
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:08.445904 16430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:08.446244 16430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:08.446393 16430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:08.454376 16430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:08.454522 16430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:08.454687 16430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:08.465328 16430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:08.466915 16430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:08.468405 16430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:08.482934 16442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:08.483000 16440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:08.483435 16445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:08.483919 16430 server_base.cc:1034] running on GCE node
I20260807 10:43:08.484668 16430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:08.485952 16430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:08.487192 16430 hybrid_clock.cc:648] HybridClock initialized: now 1786099388487131 us; error 55 us; skew 500 ppm
I20260807 10:43:08.487561 16430 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:08 dist-test-slave-42z9 krb5kdc[16066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:08.495568 16430 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:43:08.497524 16430 webserver.cc:460] Webserver started at http://127.11.46.130:37467/ using document root <none> and password file <none>
I20260807 10:43:08.498530 16430 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:08.498665 16430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:08.498971 16430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:08.502573 16430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "bbb7abd54afd4a7785bc3367050a7f46"
format_stamp: "Formatted at 2026-08-07 10:43:08 on dist-test-slave-42z9"
server_key: "abb781fe9b9fd664f0217afe382b218b"
server_key_iv: "26ea3dc510b4b78eccf56a7b2b048ae5"
server_key_version: "encryptionkey@0"
I20260807 10:43:08.503454 16430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "bbb7abd54afd4a7785bc3367050a7f46"
format_stamp: "Formatted at 2026-08-07 10:43:08 on dist-test-slave-42z9"
server_key: "abb781fe9b9fd664f0217afe382b218b"
server_key_iv: "26ea3dc510b4b78eccf56a7b2b048ae5"
server_key_version: "encryptionkey@0"
I20260807 10:43:08.509618 16430 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260807 10:43:08.513481 16452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:08.514912 16430 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:43:08.515066 16430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "bbb7abd54afd4a7785bc3367050a7f46"
format_stamp: "Formatted at 2026-08-07 10:43:08 on dist-test-slave-42z9"
server_key: "abb781fe9b9fd664f0217afe382b218b"
server_key_iv: "26ea3dc510b4b78eccf56a7b2b048ae5"
server_key_version: "encryptionkey@0"
I20260807 10:43:08.515255 16430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:08.535971 16430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:08.541080 16430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:08.541390 16430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:08.542536 16430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:08.544082 16430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:08.544167 16430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:08.544284 16430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:08.544329 16430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:08.577147 16430 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:42663
I20260807 10:43:08.577200 16626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:42663 every 8 connection(s)
I20260807 10:43:08.578682 16430 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:08.580188 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 16430
I20260807 10:43:08.580396 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:43:08.580883 11450 external_mini_cluster.cc:1428] Setting key 819dabd4b1b5fc4eda0b50d412010ba1
Aug 07 10:43:08 dist-test-slave-42z9 krb5kdc[16066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:08.602735 16629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:08.581786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:59573 (local address 127.11.46.190:41825)
0807 10:43:08.582302 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:08.582309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:08.583701 (+ 1392us) server_negotiation.cc:407] Connection header received
0807 10:43:08.585770 (+ 2069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:08.585776 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:08.585879 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:08.585979 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:08.587769 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:08.588555 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:08.590963 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:08.591517 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:08.591642 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:08.596003 (+ 4361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:08.596009 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:08.596012 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:08.596056 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:08.598823 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:08.599840 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:08.599846 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:08.599848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:08.600016 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:08.600568 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:08.600573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:08.600575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:08.600907 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:08.601062 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:08.602014 (+ 952us) server_negotiation.cc:299] Negotiation successful
0807 10:43:08.602324 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":224,"threads_started":1}
I20260807 10:43:08.603901 16630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:08.582519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:41825 (local address 127.11.46.130:59573)
0807 10:43:08.583525 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:08.583586 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:08.585407 (+ 1821us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:08.586278 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:08.586287 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:08.586900 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:08.587561 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:08.587583 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:08.588775 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:08.588781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:08.590787 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:08.590810 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:08.591811 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:08.591820 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:08.592134 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:08.592959 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:08.593000 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:08.595688 (+ 2688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:08.599039 (+ 3351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:08.599050 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:08.599069 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:08.599662 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:08.600156 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:08.600161 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:08.600164 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:08.600417 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:08.601063 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:08.601074 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:08.601557 (+ 483us) client_negotiation.cc:769] Sending connection context
0807 10:43:08.601872 (+ 315us) client_negotiation.cc:240] Negotiation successful
0807 10:43:08.602531 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":375,"threads_started":1}
I20260807 10:43:08.605585 16627 heartbeater.cc:347] Connected to a master server at 127.11.46.190:41825
I20260807 10:43:08.605948 16627 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:08.606819 16627 heartbeater.cc:511] Master 127.11.46.190:41825 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
I20260807 10:43:08.608656 16134 ts_manager.cc:194] Registered new tserver with Master: bbb7abd54afd4a7785bc3367050a7f46 (127.11.46.130:42663)
I20260807 10:43:08.609634 16134 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:59573
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:43:08.640265 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41825
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:09.028512 16636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:09.028887 16636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:09.029035 16636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 10:43:09.034823 16422 heartbeater.cc:503] Master 127.11.46.190:41825 was elected leader, sending a full tablet report...
W20260807 10:43:09.037274 16636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:09.037416 16636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:09.037604 16636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:09.048411 16636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:09.049947 16636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:09.051410 16636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:09.066766 16643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:09.066785 16644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:09.066823 16646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:09.067847 16636 server_base.cc:1034] running on GCE node
I20260807 10:43:09.068619 16636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:09.069746 16636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:09.070978 16636 hybrid_clock.cc:648] HybridClock initialized: now 1786099389070920 us; error 49 us; skew 500 ppm
I20260807 10:43:09.071349 16636 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:09 dist-test-slave-42z9 krb5kdc[16066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:09.074882 16636 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:43:09.076630 16636 webserver.cc:460] Webserver started at http://127.11.46.131:42105/ using document root <none> and password file <none>
I20260807 10:43:09.077392 16636 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:09.077564 16636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:09.077888 16636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:09.081284 16636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "7dbb57b4938d4c049c068cce26f5c288"
format_stamp: "Formatted at 2026-08-07 10:43:09 on dist-test-slave-42z9"
server_key: "bf03779ae05038db96ff456b27f260c3"
server_key_iv: "e9eeb90dc0d75597080e552266d2f12a"
server_key_version: "encryptionkey@0"
I20260807 10:43:09.082240 16636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "7dbb57b4938d4c049c068cce26f5c288"
format_stamp: "Formatted at 2026-08-07 10:43:09 on dist-test-slave-42z9"
server_key: "bf03779ae05038db96ff456b27f260c3"
server_key_iv: "e9eeb90dc0d75597080e552266d2f12a"
server_key_version: "encryptionkey@0"
I20260807 10:43:09.088295 16636 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:43:09.092381 16657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:09.094055 16636 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:43:09.094261 16636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "7dbb57b4938d4c049c068cce26f5c288"
format_stamp: "Formatted at 2026-08-07 10:43:09 on dist-test-slave-42z9"
server_key: "bf03779ae05038db96ff456b27f260c3"
server_key_iv: "e9eeb90dc0d75597080e552266d2f12a"
server_key_version: "encryptionkey@0"
I20260807 10:43:09.094507 16636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:09.123965 16636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:09.128595 16636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:09.128931 16636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:09.130059 16636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:09.131633 16636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:09.131721 16636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:09.131855 16636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:09.131919 16636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:09.176087 16636 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:36753
I20260807 10:43:09.176126 16838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:36753 every 8 connection(s)
I20260807 10:43:09.177594 16636 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:09.182476 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 16636
I20260807 10:43:09.182683 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:43:09.183190 11450 external_mini_cluster.cc:1428] Setting key 95295db0ca7a12f1bcd56f410dd84ae9
Aug 07 10:43:09 dist-test-slave-42z9 krb5kdc[16066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:09.200642 16843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:09.180867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:52483 (local address 127.11.46.190:41825)
0807 10:43:09.181406 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:09.181411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:09.182530 (+ 1119us) server_negotiation.cc:407] Connection header received
0807 10:43:09.184718 (+ 2188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:09.184724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:09.184850 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:09.184977 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:09.186882 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.187721 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.189493 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.189928 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.190035 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:09.193881 (+ 3846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:09.193888 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:09.193899 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:09.193945 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:09.196606 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:09.197689 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:09.197694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:09.197697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:09.197861 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:09.198410 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:09.198416 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:09.198419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:09.198794 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:09.198962 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:09.199935 (+ 973us) server_negotiation.cc:299] Negotiation successful
0807 10:43:09.200210 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":265,"threads_started":1}
I20260807 10:43:09.201828 16844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:09.181538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:41825 (local address 127.11.46.131:52483)
0807 10:43:09.182340 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:09.182386 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:09.184347 (+ 1961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:09.185247 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:09.185261 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:09.185926 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:09.186668 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:09.186692 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.187908 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.187913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:09.189310 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:09.189325 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.190146 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.190152 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:09.190374 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:09.191095 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:09.191123 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:09.193574 (+ 2451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:09.196812 (+ 3238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:09.196822 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:09.196839 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:09.197540 (+ 701us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:09.197992 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:09.197998 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:09.198001 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:09.198243 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:09.198963 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:09.198973 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:09.199512 (+ 539us) client_negotiation.cc:769] Sending connection context
0807 10:43:09.199784 (+ 272us) client_negotiation.cc:240] Negotiation successful
0807 10:43:09.200438 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":322,"threads_started":1}
I20260807 10:43:09.203411 16839 heartbeater.cc:347] Connected to a master server at 127.11.46.190:41825
I20260807 10:43:09.203769 16839 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:09.204612 16839 heartbeater.cc:511] Master 127.11.46.190:41825 requested a full tablet report, sending...
I20260807 10:43:09.206353 16134 ts_manager.cc:194] Registered new tserver with Master: 7dbb57b4938d4c049c068cce26f5c288 (127.11.46.131:36753)
I20260807 10:43:09.207244 16134 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:52483
I20260807 10:43:09.212178 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:43:09 dist-test-slave-42z9 krb5kdc[16066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099389, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 10:43:09 dist-test-slave-42z9 krb5kdc[16066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099389, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:09.276307 16843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:09.260909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33604 (local address 127.11.46.190:41825)
0807 10:43:09.261101 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:09.261106 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:09.261630 (+ 524us) server_negotiation.cc:407] Connection header received
0807 10:43:09.261836 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:09.261841 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:09.261938 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:09.262029 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:09.263479 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.264237 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.265626 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.266090 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.266207 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:09.270665 (+ 4458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:09.270672 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:09.270675 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:09.270725 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:09.273407 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:09.274215 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:09.274220 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:09.274222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:09.274364 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:09.274770 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:09.274775 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:09.274777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:09.275145 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:09.275383 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:09.275738 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 10:43:09.275989 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 10:43:09.276993 16134 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:33604
I20260807 10:43:09.279246 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 16222
Aug 07 10:43:09 dist-test-slave-42z9 krb5kdc[16066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099389, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:43:09.295677 16861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:09.280413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36308 (local address 127.11.46.129:39883)
0807 10:43:09.281064 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:09.281072 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:09.281100 (+ 28us) server_negotiation.cc:407] Connection header received
0807 10:43:09.281165 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:09.281172 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:09.281400 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:09.281586 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:09.282753 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.283807 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.285027 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.285717 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.285829 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:09.290035 (+ 4206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:09.290052 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:09.290072 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:09.290114 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:09.292868 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:09.293688 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:09.293697 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:09.293700 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:09.293858 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:09.294175 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:09.294178 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:09.294180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:09.294583 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:09.294832 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:09.295041 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 10:43:09.295275 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":287,"threads_started":1}
W20260807 10:43:09.297102 16415 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36308
W20260807 10:43:09.298444 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 16222: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:43:09.298727 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 16222
I20260807 10:43:09.334522 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 16430
Aug 07 10:43:09 dist-test-slave-42z9 krb5kdc[16066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099389, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:43:09.352006 16862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:09.335499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40192 (local address 127.11.46.130:42663)
0807 10:43:09.336043 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:09.336051 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:09.336079 (+ 28us) server_negotiation.cc:407] Connection header received
0807 10:43:09.336143 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:09.336150 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:09.336420 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:09.336597 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:09.338064 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.339130 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.340462 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.341071 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.341203 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:09.345720 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:09.345738 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:09.345757 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:09.345809 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:09.348746 (+ 2937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:09.349547 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:09.349555 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:09.349558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:09.349711 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:09.350137 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:09.350142 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:09.350144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:09.350570 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:09.350971 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:09.351272 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 10:43:09.351600 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":260,"threads_started":1}
W20260807 10:43:09.353617 16622 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40192
W20260807 10:43:09.354895 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 16430: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:43:09.355075 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 16430
I20260807 10:43:09.389277 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 16636
Aug 07 10:43:09 dist-test-slave-42z9 krb5kdc[16066](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099389, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:43:09.406651 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:09.390377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44828 (local address 127.11.46.131:36753)
0807 10:43:09.391050 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:09.391057 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:09.391088 (+ 31us) server_negotiation.cc:407] Connection header received
0807 10:43:09.391153 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:09.391160 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:09.391374 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:09.391521 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:09.392903 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.394081 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.395378 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:09.395977 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:09.396116 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:09.400820 (+ 4704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:09.400835 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:09.400853 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:09.400899 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:09.403786 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:09.404573 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:09.404580 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:09.404583 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:09.404726 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:09.405076 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:09.405079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:09.405081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:09.405490 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:09.405759 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:09.406017 (+ 258us) server_negotiation.cc:299] Negotiation successful
0807 10:43:09.406256 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":333,"threads_started":1}
W20260807 10:43:09.408073 16834 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:44828
W20260807 10:43:09.409243 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 16636: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:43:09.409417 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 16636
I20260807 10:43:09.441504 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 16083
I20260807 10:43:09.442823 16177 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:09.552897 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 16083
2026-08-07T10:43:09Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4215 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:43:09 dist-test-slave-42z9 krb5kdc[16876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:43:09 dist-test-slave-42z9 krb5kdc[16876](info): set up 2 sockets
Aug 07 10:43:09 dist-test-slave-42z9 krb5kdc[16876](info): commencing operation
krb5kdc: starting...
W20260807 10:43:10.777513 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.001s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:43:10 dist-test-slave-42z9 krb5kdc[16876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:43:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:43:11.055068 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35119
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:37323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:35119
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:11.438746 16901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:11.439142 16901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:11.439291 16901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:11.447423 16901 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:11.447602 16901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:11.447688 16901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:11.447767 16901 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:11.447827 16901 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:11.459194 16901 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:37323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:35119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:11.460966 16901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:11.462575 16901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:11.476169 16906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:11.476092 16908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:11.476125 16913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:11.477419 16901 server_base.cc:1034] running on GCE node
I20260807 10:43:11.478530 16901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:11.480360 16901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:11.481611 16901 hybrid_clock.cc:648] HybridClock initialized: now 1786099391481533 us; error 52 us; skew 500 ppm
I20260807 10:43:11.482041 16901 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:11 dist-test-slave-42z9 krb5kdc[16876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099391, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:11.491714 16901 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:43:11.493717 16901 webserver.cc:460] Webserver started at http://127.11.46.190:33875/ using document root <none> and password file <none>
I20260807 10:43:11.494578 16901 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:11.494716 16901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:11.495030 16901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:11.498499 16901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "5e1a43a2016f499a9f3a45f03d3aef8e"
format_stamp: "Formatted at 2026-08-07 10:43:11 on dist-test-slave-42z9"
server_key: "a297ecaecd39c4c29fc15cb8403c2256"
server_key_iv: "841598720f0cda1407820d35e7093531"
server_key_version: "encryptionkey@0"
I20260807 10:43:11.499445 16901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "5e1a43a2016f499a9f3a45f03d3aef8e"
format_stamp: "Formatted at 2026-08-07 10:43:11 on dist-test-slave-42z9"
server_key: "a297ecaecd39c4c29fc15cb8403c2256"
server_key_iv: "841598720f0cda1407820d35e7093531"
server_key_version: "encryptionkey@0"
I20260807 10:43:11.505915 16901 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260807 10:43:11.510578 16922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:11.512265 16901 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:43:11.512475 16901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "5e1a43a2016f499a9f3a45f03d3aef8e"
format_stamp: "Formatted at 2026-08-07 10:43:11 on dist-test-slave-42z9"
server_key: "a297ecaecd39c4c29fc15cb8403c2256"
server_key_iv: "841598720f0cda1407820d35e7093531"
server_key_version: "encryptionkey@0"
I20260807 10:43:11.512743 16901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:11.531409 16901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:11.536222 16901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:11.536540 16901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:11.557165 16901 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:35119
I20260807 10:43:11.557170 16996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:35119 every 8 connection(s)
I20260807 10:43:11.558871 16901 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:11.563596 16997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:11.563687 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 16901
I20260807 10:43:11.563915 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:11.564760 11450 external_mini_cluster.cc:1428] Setting key 88bdc684e713eee8b5eb76926a16087c
I20260807 10:43:11.578073 16997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e: Bootstrap starting.
Aug 07 10:43:11 dist-test-slave-42z9 krb5kdc[16876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:11.581943 16997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:11.583331 16997 log.cc:824] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:11.587249 16997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e: No bootstrap required, opened a new log
I20260807 10:43:11.590710 17003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:11.567265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35004 (local address 127.11.46.190:35119)
0807 10:43:11.568255 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:11.568269 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:11.568320 (+ 51us) server_negotiation.cc:407] Connection header received
0807 10:43:11.570928 (+ 2608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:11.570963 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:11.571507 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:11.571938 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:11.573642 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:11.575106 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:11.576526 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:11.577316 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:11.577552 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:11.582122 (+ 4570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:11.582134 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:11.582153 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:11.582206 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:11.585917 (+ 3711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:11.586944 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:11.586952 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:11.586960 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:11.587168 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:11.587629 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:11.587633 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:11.587635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:11.588244 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:11.588532 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:11.588988 (+ 456us) server_negotiation.cc:299] Negotiation successful
0807 10:43:11.589386 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718,"thread_start_us":450,"threads_started":1}
I20260807 10:43:11.596098 16997 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1a43a2016f499a9f3a45f03d3aef8e" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35119 } }
I20260807 10:43:11.596549 16997 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:11.596664 16997 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e1a43a2016f499a9f3a45f03d3aef8e, State: Initialized, Role: FOLLOWER
I20260807 10:43:11.597282 16997 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1a43a2016f499a9f3a45f03d3aef8e" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35119 } }
I20260807 10:43:11.597594 16997 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:11.597739 16997 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:11.597900 16997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:11.600337 16997 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1a43a2016f499a9f3a45f03d3aef8e" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35119 } }
I20260807 10:43:11.600917 16997 leader_election.cc:302] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e1a43a2016f499a9f3a45f03d3aef8e; no voters:
I20260807 10:43:11.601603 16997 leader_election.cc:288] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:11.601744 17008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:11.602459 17008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [term 1 LEADER]: Becoming Leader. State: Replica: 5e1a43a2016f499a9f3a45f03d3aef8e, State: Running, Role: LEADER
I20260807 10:43:11.603072 17008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1a43a2016f499a9f3a45f03d3aef8e" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35119 } }
I20260807 10:43:11.603797 16997 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:11.605922 17009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e1a43a2016f499a9f3a45f03d3aef8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1a43a2016f499a9f3a45f03d3aef8e" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35119 } } }
I20260807 10:43:11.606602 17009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:11.606303 17010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e1a43a2016f499a9f3a45f03d3aef8e. Latest consensus state: current_term: 1 leader_uuid: "5e1a43a2016f499a9f3a45f03d3aef8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e1a43a2016f499a9f3a45f03d3aef8e" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35119 } } }
I20260807 10:43:11.607147 17010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:11.613655 17017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:11.619820 17017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:11.631094 17017 catalog_manager.cc:1347] Generated new cluster ID: 4636c1efe14642fba4b65e044aea6492
I20260807 10:43:11.631260 17017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:11.666118 17017 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:11.667568 17017 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:11.682142 17017 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e1a43a2016f499a9f3a45f03d3aef8e: Generated new TSK 0
I20260807 10:43:11.683187 17017 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:43:11.745196 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35119
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:37323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:12.122740 17042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:12.123065 17042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:12.123186 17042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:12.130870 17042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:12.131031 17042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:12.131210 17042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:12.141848 17042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:37323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:12.143314 17042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:12.144742 17042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:12.158510 17049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:12.158591 17052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:12.158547 17050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:12.159402 17042 server_base.cc:1034] running on GCE node
I20260807 10:43:12.160043 17042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:12.161101 17042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:12.162313 17042 hybrid_clock.cc:648] HybridClock initialized: now 1786099392162250 us; error 53 us; skew 500 ppm
I20260807 10:43:12.162667 17042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:12 dist-test-slave-42z9 krb5kdc[16876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:12.165913 17042 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:43:12.167583 17042 webserver.cc:460] Webserver started at http://127.11.46.129:44879/ using document root <none> and password file <none>
I20260807 10:43:12.168365 17042 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:12.168493 17042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:12.168826 17042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:12.172266 17042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "a80535e5afbd4e92bb7cb9eb8b2b2a8b"
format_stamp: "Formatted at 2026-08-07 10:43:12 on dist-test-slave-42z9"
server_key: "aa72dbc682d26c90bff1411b35e3e74a"
server_key_iv: "d0e00e25c58bcec01e769c2fe7fe3313"
server_key_version: "encryptionkey@0"
I20260807 10:43:12.173187 17042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "a80535e5afbd4e92bb7cb9eb8b2b2a8b"
format_stamp: "Formatted at 2026-08-07 10:43:12 on dist-test-slave-42z9"
server_key: "aa72dbc682d26c90bff1411b35e3e74a"
server_key_iv: "d0e00e25c58bcec01e769c2fe7fe3313"
server_key_version: "encryptionkey@0"
I20260807 10:43:12.179180 17042 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260807 10:43:12.183184 17062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:12.184719 17042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:43:12.184918 17042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "a80535e5afbd4e92bb7cb9eb8b2b2a8b"
format_stamp: "Formatted at 2026-08-07 10:43:12 on dist-test-slave-42z9"
server_key: "aa72dbc682d26c90bff1411b35e3e74a"
server_key_iv: "d0e00e25c58bcec01e769c2fe7fe3313"
server_key_version: "encryptionkey@0"
I20260807 10:43:12.185144 17042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:12.217906 17042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:12.222365 17042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:12.222685 17042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:12.223794 17042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:12.225355 17042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:12.225462 17042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:12.225617 17042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:12.225679 17042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:12.258656 17042 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:33683
I20260807 10:43:12.258697 17227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:33683 every 8 connection(s)
I20260807 10:43:12.260149 17042 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:12.264094 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 17042
I20260807 10:43:12.264310 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:43:12.265003 11450 external_mini_cluster.cc:1428] Setting key 8058f1eca8f846ba95db6b311fc9cd60
Aug 07 10:43:12 dist-test-slave-42z9 krb5kdc[16876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:12.282533 17232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:12.262987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:46787 (local address 127.11.46.190:35119)
0807 10:43:12.263434 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:12.263439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:12.264717 (+ 1278us) server_negotiation.cc:407] Connection header received
0807 10:43:12.266898 (+ 2181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:12.266904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:12.266980 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:12.267072 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:12.268809 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:12.269885 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:12.271670 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:12.272229 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:12.272381 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:12.276083 (+ 3702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:12.276090 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:12.276094 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:12.276138 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:12.279069 (+ 2931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:12.280056 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:12.280060 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:12.280062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:12.280179 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:12.280660 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:12.280663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:12.280665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:12.280944 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:12.281056 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:12.282056 (+ 1000us) server_negotiation.cc:299] Negotiation successful
0807 10:43:12.282247 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":212,"threads_started":1}
I20260807 10:43:12.284112 17233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:12.263610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35119 (local address 127.11.46.129:46787)
0807 10:43:12.264508 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:12.264572 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:12.266610 (+ 2038us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:12.267345 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:12.267354 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:12.267936 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:12.268596 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:12.268618 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:12.270051 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:12.270055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:12.271446 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:12.271477 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:12.272481 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:12.272487 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:12.272712 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:12.273402 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:12.273433 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:12.275816 (+ 2383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:12.279242 (+ 3426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:12.279252 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:12.279272 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:12.279944 (+ 672us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:12.280281 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:12.280285 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:12.280288 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:12.280564 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:12.281087 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:12.281096 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:12.281668 (+ 572us) client_negotiation.cc:769] Sending connection context
0807 10:43:12.281987 (+ 319us) client_negotiation.cc:240] Negotiation successful
0807 10:43:12.282587 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":367,"threads_started":1}
I20260807 10:43:12.285815 17229 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35119
I20260807 10:43:12.286163 17229 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:12.287122 17229 heartbeater.cc:511] Master 127.11.46.190:35119 requested a full tablet report, sending...
I20260807 10:43:12.289851 16944 ts_manager.cc:194] Registered new tserver with Master: a80535e5afbd4e92bb7cb9eb8b2b2a8b (127.11.46.129:33683)
I20260807 10:43:12.291473 16944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:46787
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:43:12.325768 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35119
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:37323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:12.694445 17236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:12.694757 17236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:12.694864 17236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:12.702399 17236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:12.702524 17236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:12.702649 17236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:12.713160 17236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:37323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:12.714687 17236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:12.716069 17236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:12.730528 17247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:12.730419 17248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:12.730489 17251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:12.731596 17236 server_base.cc:1034] running on GCE node
I20260807 10:43:12.732342 17236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:12.733414 17236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:12.734719 17236 hybrid_clock.cc:648] HybridClock initialized: now 1786099392734641 us; error 59 us; skew 500 ppm
I20260807 10:43:12.735121 17236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:12 dist-test-slave-42z9 krb5kdc[16876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:12.738629 17236 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:43:12.740409 17236 webserver.cc:460] Webserver started at http://127.11.46.130:38349/ using document root <none> and password file <none>
I20260807 10:43:12.741222 17236 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:12.741345 17236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:12.741744 17236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:12.744980 17236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "6771f0c040fb44f0a1e13d8eab91d18c"
format_stamp: "Formatted at 2026-08-07 10:43:12 on dist-test-slave-42z9"
server_key: "f07c899d28dfc2301ee2e9b0485a8df5"
server_key_iv: "fb3f56f157d6afaaa7ac80975f919a8a"
server_key_version: "encryptionkey@0"
I20260807 10:43:12.745853 17236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "6771f0c040fb44f0a1e13d8eab91d18c"
format_stamp: "Formatted at 2026-08-07 10:43:12 on dist-test-slave-42z9"
server_key: "f07c899d28dfc2301ee2e9b0485a8df5"
server_key_iv: "fb3f56f157d6afaaa7ac80975f919a8a"
server_key_version: "encryptionkey@0"
I20260807 10:43:12.751549 17236 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:43:12.755753 17264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:12.757157 17236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:43:12.757330 17236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "6771f0c040fb44f0a1e13d8eab91d18c"
format_stamp: "Formatted at 2026-08-07 10:43:12 on dist-test-slave-42z9"
server_key: "f07c899d28dfc2301ee2e9b0485a8df5"
server_key_iv: "fb3f56f157d6afaaa7ac80975f919a8a"
server_key_version: "encryptionkey@0"
I20260807 10:43:12.757580 17236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:12.777907 17236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:12.782316 17236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:12.782639 17236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:12.783772 17236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:12.785425 17236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:12.785547 17236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 10:43:12.785687 17236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:12.785740 17236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:12.819531 17236 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:44685
I20260807 10:43:12.819591 17459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:44685 every 8 connection(s)
I20260807 10:43:12.820910 17236 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:12.824049 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 17236
I20260807 10:43:12.824262 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:43:12.824831 11450 external_mini_cluster.cc:1428] Setting key da56a3b702f5e81a34c8c39a6270a7df
Aug 07 10:43:12 dist-test-slave-42z9 krb5kdc[16876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:12.841969 17463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:12.823563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:46647 (local address 127.11.46.190:35119)
0807 10:43:12.824002 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:12.824007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:12.825278 (+ 1271us) server_negotiation.cc:407] Connection header received
0807 10:43:12.827684 (+ 2406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:12.827689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:12.827773 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:12.827869 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:12.829504 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:12.830225 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:12.831818 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:12.832272 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:12.832386 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:12.835996 (+ 3610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:12.836002 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:12.836005 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:12.836048 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:12.838614 (+ 2566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:12.839403 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:12.839407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:12.839410 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:12.839561 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:12.840012 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:12.840016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:12.840018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:12.840327 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:12.840472 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:12.841275 (+ 803us) server_negotiation.cc:299] Negotiation successful
0807 10:43:12.841574 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":218,"threads_started":1}
I20260807 10:43:12.843098 17464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:12.824210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35119 (local address 127.11.46.130:46647)
0807 10:43:12.825106 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:12.825149 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:12.827402 (+ 2253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:12.828134 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:12.828142 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:12.828710 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:12.829301 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:12.829319 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:12.830392 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:12.830396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:12.831667 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:12.831682 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:12.832542 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:12.832551 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:12.832770 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:12.833431 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:12.833504 (+ 73us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:12.835745 (+ 2241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:12.838767 (+ 3022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:12.838778 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:12.838797 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:12.839266 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:12.839678 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:12.839683 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:12.839687 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:12.839896 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:12.840465 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:12.840474 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:12.840870 (+ 396us) client_negotiation.cc:769] Sending connection context
0807 10:43:12.841160 (+ 290us) client_negotiation.cc:240] Negotiation successful
0807 10:43:12.841826 (+ 666us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":346,"threads_started":1}
I20260807 10:43:12.844738 17460 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35119
I20260807 10:43:12.845072 17460 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:12.845958 17460 heartbeater.cc:511] Master 127.11.46.190:35119 requested a full tablet report, sending...
I20260807 10:43:12.847714 16944 ts_manager.cc:194] Registered new tserver with Master: 6771f0c040fb44f0a1e13d8eab91d18c (127.11.46.130:44685)
I20260807 10:43:12.848981 16944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:46647
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:43:12.882057 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35119
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:37323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:13.253736 17468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:13.254050 17468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:13.254155 17468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:13.261899 17468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:13.262030 17468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:13.262181 17468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:13.272701 17468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:37323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:13.274313 17468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:13.275784 17468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:13.290387 17477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:13.290285 17475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:13.290333 17482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:13.291260 17468 server_base.cc:1034] running on GCE node
I20260807 10:43:13.291925 17468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:13.293056 17468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:13.294297 17468 hybrid_clock.cc:648] HybridClock initialized: now 1786099393294224 us; error 57 us; skew 500 ppm
I20260807 10:43:13.294664 17468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:43:13.295051 17229 heartbeater.cc:503] Master 127.11.46.190:35119 was elected leader, sending a full tablet report...
Aug 07 10:43:13 dist-test-slave-42z9 krb5kdc[16876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:13.298220 17468 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:43:13.299955 17468 webserver.cc:460] Webserver started at http://127.11.46.131:41987/ using document root <none> and password file <none>
I20260807 10:43:13.300741 17468 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:13.300868 17468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:13.301211 17468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:13.304461 17468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "22359896977544ff820b2a93ffc16477"
format_stamp: "Formatted at 2026-08-07 10:43:13 on dist-test-slave-42z9"
server_key: "be4afbd0f9db7332f89448304904da08"
server_key_iv: "2fb89118939d5e01156b2166edcbf34e"
server_key_version: "encryptionkey@0"
I20260807 10:43:13.305333 17468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "22359896977544ff820b2a93ffc16477"
format_stamp: "Formatted at 2026-08-07 10:43:13 on dist-test-slave-42z9"
server_key: "be4afbd0f9db7332f89448304904da08"
server_key_iv: "2fb89118939d5e01156b2166edcbf34e"
server_key_version: "encryptionkey@0"
I20260807 10:43:13.311184 17468 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 10:43:13.315205 17493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:13.316740 17468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:43:13.316916 17468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "22359896977544ff820b2a93ffc16477"
format_stamp: "Formatted at 2026-08-07 10:43:13 on dist-test-slave-42z9"
server_key: "be4afbd0f9db7332f89448304904da08"
server_key_iv: "2fb89118939d5e01156b2166edcbf34e"
server_key_version: "encryptionkey@0"
I20260807 10:43:13.317168 17468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:13.345657 17468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:13.350383 17468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:13.350730 17468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:13.351864 17468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:13.353549 17468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:13.353641 17468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:13.353771 17468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:13.353826 17468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:13.388360 17468 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:36883
I20260807 10:43:13.388410 17660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:36883 every 8 connection(s)
I20260807 10:43:13.389863 17468 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:13.391021 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 17468
I20260807 10:43:13.391230 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:43:13.391724 11450 external_mini_cluster.cc:1428] Setting key 9460d1fad3f15918d2be621a632ef022
Aug 07 10:43:13 dist-test-slave-42z9 krb5kdc[16876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099393, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:13.412575 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:13.392922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:60593 (local address 127.11.46.190:35119)
0807 10:43:13.393399 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:13.393405 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:13.394636 (+ 1231us) server_negotiation.cc:407] Connection header received
0807 10:43:13.396762 (+ 2126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:13.396766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:13.396858 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:13.396958 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:13.398690 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.399527 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.401173 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.401661 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.401774 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:13.405577 (+ 3803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:13.405583 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:13.405586 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:13.405627 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:13.408948 (+ 3321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.409911 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.409915 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.409918 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.410070 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.410575 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.410579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.410582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.410895 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:13.411068 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:13.411893 (+ 825us) server_negotiation.cc:299] Negotiation successful
0807 10:43:13.412175 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":397,"threads_started":1}
I20260807 10:43:13.413766 17664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:13.393484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35119 (local address 127.11.46.131:60593)
0807 10:43:13.394450 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:13.394516 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:13.396480 (+ 1964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:13.397176 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:13.397185 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:13.397858 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:13.398518 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:13.398539 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.399661 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.399664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:13.400994 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:13.401015 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.401870 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.401875 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:13.402105 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:13.402817 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:13.402843 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:13.405281 (+ 2438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:13.409128 (+ 3847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:13.409138 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:13.409157 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:13.409775 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:13.410197 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:13.410201 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:13.410203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:13.410444 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:13.411057 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:13.411067 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:13.411475 (+ 408us) client_negotiation.cc:769] Sending connection context
0807 10:43:13.411744 (+ 269us) client_negotiation.cc:240] Negotiation successful
0807 10:43:13.412367 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":391,"threads_started":1}
I20260807 10:43:13.415369 17661 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35119
I20260807 10:43:13.415720 17661 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:13.416584 17661 heartbeater.cc:511] Master 127.11.46.190:35119 requested a full tablet report, sending...
I20260807 10:43:13.418279 16944 ts_manager.cc:194] Registered new tserver with Master: 22359896977544ff820b2a93ffc16477 (127.11.46.131:36883)
I20260807 10:43:13.419248 16944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:60593
I20260807 10:43:13.421243 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:43:13 dist-test-slave-42z9 krb5kdc[16876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 10:43:13 dist-test-slave-42z9 krb5kdc[16876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:43:13.486939 17671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:13.470864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43400 (local address 127.11.46.129:33683)
0807 10:43:13.471567 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:13.471575 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:13.471605 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:43:13.471673 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:13.471680 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:13.471922 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:13.472066 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:13.473651 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.474718 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.475940 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.476546 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.476655 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:13.480681 (+ 4026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:13.480698 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:13.480716 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:13.480759 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:13.483777 (+ 3018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.484620 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.484627 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.484629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.484765 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.485256 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.485260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.485263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.485760 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:13.486015 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:13.486310 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 10:43:13.486549 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":352,"threads_started":1}
Aug 07 10:43:13 dist-test-slave-42z9 krb5kdc[16876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:13.506872 17663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:13.491855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35020 (local address 127.11.46.190:35119)
0807 10:43:13.492089 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:13.492095 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:13.492240 (+ 145us) server_negotiation.cc:407] Connection header received
0807 10:43:13.492429 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:13.492435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:13.492526 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:13.492617 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:13.494037 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.494794 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.496091 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.496540 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.496658 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:13.500938 (+ 4280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:13.500944 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:13.500947 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:13.500996 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:13.503664 (+ 2668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.504543 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.504548 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.504551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.504744 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.505166 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.505172 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.505175 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.505677 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:13.505933 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:13.506283 (+ 350us) server_negotiation.cc:299] Negotiation successful
0807 10:43:13.506547 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260807 10:43:13.507593 16944 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35020
I20260807 10:43:13.508702 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 17042
I20260807 10:43:13.522547 17671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:13.509667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43412 (local address 127.11.46.129:33683)
0807 10:43:13.509878 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:13.509885 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:13.510141 (+ 256us) server_negotiation.cc:407] Connection header received
0807 10:43:13.510306 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:13.510312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:13.510431 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:13.510520 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:13.511792 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.512705 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.514027 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.514525 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.514639 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:13.517070 (+ 2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:13.517077 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:13.517080 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:13.517144 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:13.519779 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.520509 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.520515 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.520518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.520669 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.521045 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.521050 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.521052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.521340 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:13.521647 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:13.521966 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 10:43:13.522211 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:43:13.523253 17219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:13.609392 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 17042
I20260807 10:43:13.638736 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 17236
Aug 07 10:43:13 dist-test-slave-42z9 krb5kdc[16876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:43:13.656683 17678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:13.639703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33606 (local address 127.11.46.130:44685)
0807 10:43:13.640305 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:13.640312 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:13.640340 (+ 28us) server_negotiation.cc:407] Connection header received
0807 10:43:13.640403 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:13.640409 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:13.640644 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:13.640807 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:13.642151 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.643238 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.644555 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.645170 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.645302 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:13.649980 (+ 4678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:13.650001 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:13.650021 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:13.650082 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:13.653133 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.654151 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.654161 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.654164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.654339 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.654783 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.654787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.654790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.655248 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:13.655629 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:13.655987 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 10:43:13.656309 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":291,"threads_started":1}
I20260807 10:43:13.658221 17450 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:13.743815 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 17236
I20260807 10:43:13.770815 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 17468
Aug 07 10:43:13 dist-test-slave-42z9 krb5kdc[16876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:43:13.788626 17680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:13.771921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43816 (local address 127.11.46.131:36883)
0807 10:43:13.772590 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:13.772597 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:13.772628 (+ 31us) server_negotiation.cc:407] Connection header received
0807 10:43:13.772695 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:13.772701 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:13.772924 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:13.773083 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:13.774521 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.775592 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.776877 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:13.777621 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:13.777754 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:13.782430 (+ 4676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:13.782448 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:13.782467 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:13.782512 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:13.785322 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.786180 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.786189 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.786191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.786345 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:13.786768 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:13.786772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:13.786774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:13.787210 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:13.787543 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:13.787926 (+ 383us) server_negotiation.cc:299] Negotiation successful
0807 10:43:13.788238 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":323,"threads_started":1}
I20260807 10:43:13.790210 17655 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:13.876729 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 17468
I20260807 10:43:13.901695 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 16901
I20260807 10:43:13.902998 16988 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:14.015167 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 16901
2026-08-07T10:43:14Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4463 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:43:14 dist-test-slave-42z9 krb5kdc[17689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:43:14 dist-test-slave-42z9 krb5kdc[17689](info): set up 2 sockets
Aug 07 10:43:14 dist-test-slave-42z9 krb5kdc[17689](info): commencing operation
krb5kdc: starting...
W20260807 10:43:15.240705 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.005s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:43:15 dist-test-slave-42z9 krb5kdc[17689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:43:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:43:15.521009 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:41337
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:41337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:15.888391 17710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:15.888758 17710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:15.888924 17710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:15.896657 17710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:15.896811 17710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:15.896899 17710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:15.896981 17710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:15.897047 17710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:15.908007 17710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:41337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:41337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:15.909528 17710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:15.911080 17710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:15.923792 17716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:15.923733 17726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:15.923808 17720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:15.924674 17710 server_base.cc:1034] running on GCE node
I20260807 10:43:15.925580 17710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:15.927237 17710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:15.928491 17710 hybrid_clock.cc:648] HybridClock initialized: now 1786099395928422 us; error 61 us; skew 500 ppm
I20260807 10:43:15.928902 17710 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:15 dist-test-slave-42z9 krb5kdc[17689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099395, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:15.932744 17710 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:43:15.934118 17710 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:15.934234 17710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:15.934610 17710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:15.938139 17710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "167be35ac6a44346b04ee6d6dfa70443"
format_stamp: "Formatted at 2026-08-07 10:43:15 on dist-test-slave-42z9"
server_key: "7d4acbb8efbaade4c91bb119e4220489"
server_key_iv: "d3e432ac24686eb417377aab0a4c353e"
server_key_version: "encryptionkey@0"
I20260807 10:43:15.939075 17710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "167be35ac6a44346b04ee6d6dfa70443"
format_stamp: "Formatted at 2026-08-07 10:43:15 on dist-test-slave-42z9"
server_key: "7d4acbb8efbaade4c91bb119e4220489"
server_key_iv: "d3e432ac24686eb417377aab0a4c353e"
server_key_version: "encryptionkey@0"
I20260807 10:43:15.945142 17710 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260807 10:43:15.949386 17733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:15.951035 17710 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 10:43:15.951241 17710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "167be35ac6a44346b04ee6d6dfa70443"
format_stamp: "Formatted at 2026-08-07 10:43:15 on dist-test-slave-42z9"
server_key: "7d4acbb8efbaade4c91bb119e4220489"
server_key_iv: "d3e432ac24686eb417377aab0a4c353e"
server_key_version: "encryptionkey@0"
I20260807 10:43:15.951496 17710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:15.966688 17710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:15.971591 17710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:15.971903 17710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:15.992309 17710 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:41337
I20260807 10:43:15.992288 17817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:41337 every 8 connection(s)
I20260807 10:43:15.993333 17710 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:15.997326 17818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:15.998930 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 17710
I20260807 10:43:15.999154 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:15.999851 11450 external_mini_cluster.cc:1428] Setting key 5760e192c59087cee3319b33ce082ea3
I20260807 10:43:16.013312 17818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443: Bootstrap starting.
Aug 07 10:43:16 dist-test-slave-42z9 krb5kdc[17689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:16.016889 17818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:16.018407 17818 log.cc:824] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:16.022425 17818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443: No bootstrap required, opened a new log
I20260807 10:43:16.025833 17821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:16.002164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49076 (local address 127.11.46.190:41337)
0807 10:43:16.003058 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:16.003076 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:16.003137 (+ 61us) server_negotiation.cc:407] Connection header received
0807 10:43:16.004902 (+ 1765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:16.004941 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:16.005573 (+ 632us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:16.006031 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:16.007838 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:16.010028 (+ 2190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:16.011447 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:16.012555 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:16.012748 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:16.016887 (+ 4139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:16.016900 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:16.016923 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:16.016987 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:16.020979 (+ 3992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:16.021905 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:16.021915 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:16.021925 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:16.022164 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:16.022692 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:16.022697 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:16.022699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:16.023342 (+ 643us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:16.023659 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:16.024174 (+ 515us) server_negotiation.cc:299] Negotiation successful
0807 10:43:16.024665 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":379,"threads_started":1}
I20260807 10:43:16.031617 17818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "167be35ac6a44346b04ee6d6dfa70443" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41337 } }
I20260807 10:43:16.032109 17818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:16.032213 17818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 167be35ac6a44346b04ee6d6dfa70443, State: Initialized, Role: FOLLOWER
I20260807 10:43:16.032900 17818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "167be35ac6a44346b04ee6d6dfa70443" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41337 } }
I20260807 10:43:16.033164 17818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:16.033309 17818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:16.033519 17818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:16.036496 17818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "167be35ac6a44346b04ee6d6dfa70443" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41337 } }
I20260807 10:43:16.037133 17818 leader_election.cc:302] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 167be35ac6a44346b04ee6d6dfa70443; no voters:
I20260807 10:43:16.037837 17818 leader_election.cc:288] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:16.037985 17824 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:16.039322 17824 raft_consensus.cc:686] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [term 1 LEADER]: Becoming Leader. State: Replica: 167be35ac6a44346b04ee6d6dfa70443, State: Running, Role: LEADER
I20260807 10:43:16.040064 17824 consensus_queue.cc:237] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "167be35ac6a44346b04ee6d6dfa70443" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41337 } }
I20260807 10:43:16.040521 17818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:16.042955 17830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 167be35ac6a44346b04ee6d6dfa70443. Latest consensus state: current_term: 1 leader_uuid: "167be35ac6a44346b04ee6d6dfa70443" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "167be35ac6a44346b04ee6d6dfa70443" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41337 } } }
I20260807 10:43:16.043319 17830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:16.043639 17829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "167be35ac6a44346b04ee6d6dfa70443" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "167be35ac6a44346b04ee6d6dfa70443" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 41337 } } }
I20260807 10:43:16.043990 17829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:16.046574 17839 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:16.053076 17839 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:16.063712 17839 catalog_manager.cc:1347] Generated new cluster ID: d09c8b2320bf439b8a48fb56761ed681
I20260807 10:43:16.063850 17839 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:16.077332 17839 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:16.079448 17839 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:16.091281 17839 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443: Generated new TSK 0
I20260807 10:43:16.092610 17839 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:43:16.159466 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41337
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:16.532814 17865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:16.533181 17865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:16.533291 17865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:16.541256 17865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:16.541390 17865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:16.541565 17865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:16.552446 17865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:16.554028 17865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:16.555773 17865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:16.570083 17874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:16.570082 17879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:16.570634 17873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:16.571147 17865 server_base.cc:1034] running on GCE node
I20260807 10:43:16.571862 17865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:16.572944 17865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:16.574156 17865 hybrid_clock.cc:648] HybridClock initialized: now 1786099396574096 us; error 48 us; skew 500 ppm
I20260807 10:43:16.574535 17865 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:16 dist-test-slave-42z9 krb5kdc[17689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099396, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:16.580436 17865 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:43:16.581904 17865 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:16.582043 17865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:16.582403 17865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:16.585841 17865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "ba638523dbd048b89a13ba11364484a3"
format_stamp: "Formatted at 2026-08-07 10:43:16 on dist-test-slave-42z9"
server_key: "1515ff9473f4f57029677c2d41780664"
server_key_iv: "efed97f85182bc1cfd5c798aca59c1d0"
server_key_version: "encryptionkey@0"
I20260807 10:43:16.586766 17865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "ba638523dbd048b89a13ba11364484a3"
format_stamp: "Formatted at 2026-08-07 10:43:16 on dist-test-slave-42z9"
server_key: "1515ff9473f4f57029677c2d41780664"
server_key_iv: "efed97f85182bc1cfd5c798aca59c1d0"
server_key_version: "encryptionkey@0"
I20260807 10:43:16.592749 17865 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260807 10:43:16.596925 17888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:16.598515 17865 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:43:16.598711 17865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "ba638523dbd048b89a13ba11364484a3"
format_stamp: "Formatted at 2026-08-07 10:43:16 on dist-test-slave-42z9"
server_key: "1515ff9473f4f57029677c2d41780664"
server_key_iv: "efed97f85182bc1cfd5c798aca59c1d0"
server_key_version: "encryptionkey@0"
I20260807 10:43:16.598976 17865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:16.619006 17865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:16.623467 17865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:16.623759 17865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:16.624840 17865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:16.626426 17865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:16.626536 17865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:16.626658 17865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:16.626734 17865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:16.660801 17865 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:34899
I20260807 10:43:16.660856 18061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:34899 every 8 connection(s)
I20260807 10:43:16.661837 17865 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:16.668076 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 17865
I20260807 10:43:16.668290 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:43:16.668926 11450 external_mini_cluster.cc:1428] Setting key 3f3fd5be59dedf5a034d56076b522c4e
Aug 07 10:43:16 dist-test-slave-42z9 krb5kdc[17689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099396, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:16.683593 18068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:16.664502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:49169 (local address 127.11.46.190:41337)
0807 10:43:16.664993 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:16.664998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:16.666062 (+ 1064us) server_negotiation.cc:407] Connection header received
0807 10:43:16.668046 (+ 1984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:16.668052 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:16.668152 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:16.668272 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:16.670215 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:16.671194 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:16.672982 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:16.673402 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:16.673574 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:16.677534 (+ 3960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:16.677540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:16.677543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:16.677585 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:16.680061 (+ 2476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:16.680951 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:16.680958 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:16.680960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:16.681110 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:16.681625 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:16.681629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:16.681632 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:16.681934 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:16.682090 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:16.682910 (+ 820us) server_negotiation.cc:299] Negotiation successful
0807 10:43:16.683203 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":356,"thread_start_us":237,"threads_started":1}
I20260807 10:43:16.684720 18069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:16.665083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:41337 (local address 127.11.46.129:49169)
0807 10:43:16.665883 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:16.665933 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:16.667720 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:16.668537 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:16.668546 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:16.669170 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:16.670025 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:16.670050 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:16.671378 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:16.671382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:16.672799 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:16.672815 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:16.673701 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:16.673708 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:16.673994 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:16.674769 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:16.674796 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:16.677218 (+ 2422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:16.680249 (+ 3031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:16.680259 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:16.680276 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:16.680807 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:16.681236 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:16.681241 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:16.681243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:16.681492 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:16.682084 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:16.682093 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:16.682479 (+ 386us) client_negotiation.cc:769] Sending connection context
0807 10:43:16.682758 (+ 279us) client_negotiation.cc:240] Negotiation successful
0807 10:43:16.683388 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":342,"threads_started":1}
I20260807 10:43:16.686623 18064 heartbeater.cc:347] Connected to a master server at 127.11.46.190:41337
I20260807 10:43:16.687063 18064 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:16.687999 18064 heartbeater.cc:511] Master 127.11.46.190:41337 requested a full tablet report, sending...
I20260807 10:43:16.691115 17757 ts_manager.cc:194] Registered new tserver with Master: ba638523dbd048b89a13ba11364484a3 (127.11.46.129:34899)
I20260807 10:43:16.693329 17757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:49169
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:43:16.730638 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41337
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:17.103169 18072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:17.103510 18072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:17.103624 18072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:17.111299 18072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:17.111436 18072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:17.111558 18072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:17.122288 18072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:17.123704 18072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:17.125099 18072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:17.139376 18084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:17.139453 18081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:17.139473 18079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:17.140331 18072 server_base.cc:1034] running on GCE node
I20260807 10:43:17.141034 18072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:17.142202 18072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:17.143414 18072 hybrid_clock.cc:648] HybridClock initialized: now 1786099397143339 us; error 66 us; skew 500 ppm
I20260807 10:43:17.143764 18072 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:17 dist-test-slave-42z9 krb5kdc[17689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099397, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:17.147284 18072 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:43:17.148588 18072 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:17.148691 18072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:17.148995 18072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:17.153062 18072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "fd79d6aa7be547fca4a2548ea043788f"
format_stamp: "Formatted at 2026-08-07 10:43:17 on dist-test-slave-42z9"
server_key: "d6f400d8d3d491e1849e0e76edb55ef4"
server_key_iv: "cebe62a6e29c6a3b807d3c683a0e70dd"
server_key_version: "encryptionkey@0"
I20260807 10:43:17.154270 18072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "fd79d6aa7be547fca4a2548ea043788f"
format_stamp: "Formatted at 2026-08-07 10:43:17 on dist-test-slave-42z9"
server_key: "d6f400d8d3d491e1849e0e76edb55ef4"
server_key_iv: "cebe62a6e29c6a3b807d3c683a0e70dd"
server_key_version: "encryptionkey@0"
I20260807 10:43:17.160774 18072 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:43:17.164987 18096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:17.166671 18072 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:43:17.166880 18072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "fd79d6aa7be547fca4a2548ea043788f"
format_stamp: "Formatted at 2026-08-07 10:43:17 on dist-test-slave-42z9"
server_key: "d6f400d8d3d491e1849e0e76edb55ef4"
server_key_iv: "cebe62a6e29c6a3b807d3c683a0e70dd"
server_key_version: "encryptionkey@0"
I20260807 10:43:17.167171 18072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:17.192631 18072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:17.197118 18072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:17.197394 18072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:17.198545 18072 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:17.200227 18072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:17.200330 18072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:17.200423 18072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:17.200480 18072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:17.235389 18072 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:43637
I20260807 10:43:17.235455 18259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:43637 every 8 connection(s)
I20260807 10:43:17.236349 18072 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:17.239058 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 18072
I20260807 10:43:17.239303 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:43:17.239915 11450 external_mini_cluster.cc:1428] Setting key fcde2af2f9febbcbaeb4245cc79f74de
Aug 07 10:43:17 dist-test-slave-42z9 krb5kdc[17689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099397, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:17.260212 18264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.239044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:52897 (local address 127.11.46.190:41337)
0807 10:43:17.239660 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:17.239665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:17.241008 (+ 1343us) server_negotiation.cc:407] Connection header received
0807 10:43:17.243394 (+ 2386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:17.243400 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:17.243497 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:17.243595 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:17.245340 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.246154 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.247884 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.248341 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.248459 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.252462 (+ 4003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:17.252468 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:17.252472 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:17.252513 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:17.255559 (+ 3046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:17.256491 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:17.256498 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:17.256501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:17.256667 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:17.257097 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:17.257102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:17.257104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:17.257484 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:17.257648 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:17.259554 (+ 1906us) server_negotiation.cc:299] Negotiation successful
0807 10:43:17.259852 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":381,"threads_started":1}
I20260807 10:43:17.260670 18265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.239825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:41337 (local address 127.11.46.130:52897)
0807 10:43:17.240812 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:17.240878 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:17.243092 (+ 2214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:17.243885 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:17.243894 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:17.244501 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:17.245144 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:17.245163 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.246328 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.246333 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:17.247716 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:17.247732 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.248608 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.248616 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:17.248868 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.249588 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:17.249615 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:17.252157 (+ 2542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:17.255781 (+ 3624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:17.255795 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:17.255810 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:17.256354 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:17.256773 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:17.256776 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:17.256779 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:17.256986 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:17.257595 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:17.257602 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:17.257985 (+ 383us) client_negotiation.cc:769] Sending connection context
0807 10:43:17.258281 (+ 296us) client_negotiation.cc:240] Negotiation successful
0807 10:43:17.258979 (+ 698us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":399,"threads_started":1}
I20260807 10:43:17.262532 18262 heartbeater.cc:347] Connected to a master server at 127.11.46.190:41337
I20260807 10:43:17.262881 18262 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:17.263615 18262 heartbeater.cc:511] Master 127.11.46.190:41337 requested a full tablet report, sending...
I20260807 10:43:17.265429 17757 ts_manager.cc:194] Registered new tserver with Master: fd79d6aa7be547fca4a2548ea043788f (127.11.46.130:43637)
I20260807 10:43:17.266351 17757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:52897
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:43:17.303054 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41337
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:17.677970 18271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:17.678323 18271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:17.678436 18271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:17.686090 18271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:17.686232 18271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:17.686362 18271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:17.696964 18271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:41337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:17.697932 18064 heartbeater.cc:503] Master 127.11.46.190:41337 was elected leader, sending a full tablet report...
I20260807 10:43:17.698657 18271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:17.700323 18271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:17.715039 18285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:17.715160 18283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:17.715168 18282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:17.716279 18271 server_base.cc:1034] running on GCE node
I20260807 10:43:17.716954 18271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:17.718091 18271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:17.719309 18271 hybrid_clock.cc:648] HybridClock initialized: now 1786099397719244 us; error 56 us; skew 500 ppm
I20260807 10:43:17.719678 18271 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:17 dist-test-slave-42z9 krb5kdc[17689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099397, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:17.723098 18271 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:43:17.724463 18271 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:17.724577 18271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:17.724889 18271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:17.728488 18271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "4847c20255224b7da7ecbcb3acfa1bd6"
format_stamp: "Formatted at 2026-08-07 10:43:17 on dist-test-slave-42z9"
server_key: "c750dda9dd64f466b29e0ebf30484989"
server_key_iv: "0eabd8c90cfe0fcb21b4308348535c9e"
server_key_version: "encryptionkey@0"
I20260807 10:43:17.729579 18271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "4847c20255224b7da7ecbcb3acfa1bd6"
format_stamp: "Formatted at 2026-08-07 10:43:17 on dist-test-slave-42z9"
server_key: "c750dda9dd64f466b29e0ebf30484989"
server_key_iv: "0eabd8c90cfe0fcb21b4308348535c9e"
server_key_version: "encryptionkey@0"
I20260807 10:43:17.736032 18271 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:43:17.740762 18295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:17.742504 18271 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 10:43:17.742728 18271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "4847c20255224b7da7ecbcb3acfa1bd6"
format_stamp: "Formatted at 2026-08-07 10:43:17 on dist-test-slave-42z9"
server_key: "c750dda9dd64f466b29e0ebf30484989"
server_key_iv: "0eabd8c90cfe0fcb21b4308348535c9e"
server_key_version: "encryptionkey@0"
I20260807 10:43:17.743005 18271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:17.780053 18271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:17.784744 18271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:17.785053 18271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:17.786249 18271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:17.787884 18271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:17.787992 18271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:17.788116 18271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:17.788197 18271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:17.822832 18271 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:33283
I20260807 10:43:17.822844 18457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:33283 every 8 connection(s)
I20260807 10:43:17.823868 18271 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:17.832939 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 18271
I20260807 10:43:17.833163 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:43:17.833675 11450 external_mini_cluster.cc:1428] Setting key ed7af783f74ede4c98b424951a6263a3
Aug 07 10:43:17 dist-test-slave-42z9 krb5kdc[17689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099397, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:17.846519 18460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.826696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:35939 (local address 127.11.46.190:41337)
0807 10:43:17.827173 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:17.827177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:17.828336 (+ 1159us) server_negotiation.cc:407] Connection header received
0807 10:43:17.830808 (+ 2472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:17.830814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:17.830927 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:17.831024 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:17.832873 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.833767 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.835817 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.836363 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.836471 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.840506 (+ 4035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:17.840512 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:17.840515 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:17.840587 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:17.843405 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:17.844218 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:17.844221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:17.844224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:17.844350 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:17.844715 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:17.844717 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:17.844719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:17.845011 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:17.845133 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:17.845954 (+ 821us) server_negotiation.cc:299] Negotiation successful
0807 10:43:17.846214 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":215,"threads_started":1}
I20260807 10:43:17.847606 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.827326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:41337 (local address 127.11.46.131:35939)
0807 10:43:17.828127 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:17.828174 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:17.830429 (+ 2255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:17.831269 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:17.831279 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:17.831935 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:17.832621 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:17.832643 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.833957 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.833961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:17.835619 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:17.835639 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.836639 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.836648 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:17.836981 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.837755 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:17.837782 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:17.840202 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:17.843578 (+ 3376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:17.843588 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:17.843604 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:17.844109 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:17.844430 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:17.844433 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:17.844436 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:17.844628 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:17.845118 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:17.845124 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:17.845549 (+ 425us) client_negotiation.cc:769] Sending connection context
0807 10:43:17.845833 (+ 284us) client_negotiation.cc:240] Negotiation successful
0807 10:43:17.846337 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":320,"threads_started":1}
I20260807 10:43:17.849282 18458 heartbeater.cc:347] Connected to a master server at 127.11.46.190:41337
I20260807 10:43:17.849681 18458 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:17.850497 18458 heartbeater.cc:511] Master 127.11.46.190:41337 requested a full tablet report, sending...
I20260807 10:43:17.852124 17757 ts_manager.cc:194] Registered new tserver with Master: 4847c20255224b7da7ecbcb3acfa1bd6 (127.11.46.131:33283)
I20260807 10:43:17.853030 17757 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:35939
I20260807 10:43:17.862898 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:43:17.881345 18460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.868111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49080 (local address 127.11.46.190:41337)
0807 10:43:17.868306 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:17.868310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:17.868810 (+ 500us) server_negotiation.cc:407] Connection header received
0807 10:43:17.868974 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:17.868978 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:17.869077 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:17.869175 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:17.870748 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.871539 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.872862 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.873316 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.873425 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.875952 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:17.875958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:17.875962 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:17.876007 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:17.878805 (+ 2798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:17.879541 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:17.879544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:17.879547 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:17.879681 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:17.880041 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:17.880044 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:17.880046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:17.880408 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:17.880632 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:17.880878 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 10:43:17.881098 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:43:17.886088 17757 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:43:17.893599 17757 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:43:17.930984 18482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.907327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:33283 (local address 127.0.0.1:33238)
0807 10:43:17.919385 (+ 12058us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:17.919410 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:17.919586 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:17.923694 (+ 4108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:17.923699 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:17.923725 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:17.924090 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:17.924104 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.926269 (+ 2165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.926273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:17.928135 (+ 1862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:17.928149 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.930016 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.930022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:17.930187 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.930219 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 10:43:17.930327 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 10:43:17.930466 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11867,"mutex_wait_us":1,"thread_start_us":11684,"threads_started":1}
I20260807 10:43:17.931437 18480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.907220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55802 (local address 127.11.46.129:34899)
0807 10:43:17.920609 (+ 13389us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:17.920626 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:17.920697 (+ 71us) server_negotiation.cc:407] Connection header received
0807 10:43:17.920875 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:17.920887 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:17.921344 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:17.922633 (+ 1289us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:17.923566 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.924728 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.927708 (+ 2980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.929180 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.929326 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.929647 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:17.930727 (+ 1080us) server_negotiation.cc:299] Negotiation successful
0807 10:43:17.930932 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13030,"thread_start_us":12811,"threads_started":1}
I20260807 10:43:17.931499 18479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.907800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:43637 (local address 127.0.0.1:49272)
0807 10:43:17.920141 (+ 12341us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:17.920163 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:17.920331 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:17.922787 (+ 2456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:17.922792 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:17.922822 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:17.923332 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:17.923348 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.925777 (+ 2429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.925783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:17.928556 (+ 2773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:17.928572 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.930625 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.930633 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:17.930835 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.930883 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 10:43:17.930957 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 10:43:17.931099 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12207,"mutex_wait_us":25,"thread_start_us":10192,"threads_started":1}
I20260807 10:43:17.931476 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.907996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33238 (local address 127.11.46.131:33283)
0807 10:43:17.923001 (+ 15005us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:17.923011 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:17.923052 (+ 41us) server_negotiation.cc:407] Connection header received
0807 10:43:17.923165 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:17.923173 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:17.923451 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:17.924323 (+ 872us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:17.924675 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.926116 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.928320 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.929768 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.929921 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.930170 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:17.930403 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 10:43:17.930602 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14765,"thread_start_us":14724,"threads_started":1}
I20260807 10:43:17.930598 18483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.906987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:34899 (local address 127.0.0.1:55802)
0807 10:43:17.917380 (+ 10393us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:17.917479 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:17.917733 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:17.921810 (+ 4077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:17.921819 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:17.921864 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:17.922344 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:17.922360 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.924892 (+ 2532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.924898 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:17.927466 (+ 2568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:17.927491 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.929413 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.929419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:17.929686 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.929748 (+ 62us) client_negotiation.cc:769] Sending connection context
0807 10:43:17.929883 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 10:43:17.930145 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10011,"thread_start_us":12864,"threads_started":1}
I20260807 10:43:17.932744 18485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:17.909393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49272 (local address 127.11.46.130:43637)
0807 10:43:17.922068 (+ 12675us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:17.922079 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:17.922113 (+ 34us) server_negotiation.cc:407] Connection header received
0807 10:43:17.922227 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:17.922235 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:17.922529 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:17.923587 (+ 1058us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:17.923932 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.925601 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.928773 (+ 3172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:17.930335 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:17.931874 (+ 1539us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:17.932104 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:17.932190 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 10:43:17.932402 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12479,"thread_start_us":12285,"threads_started":1}
I20260807 10:43:17.935985 18364 tablet_service.cc:1467] Processing CreateTablet for tablet cc97c0f0cc524e6e860926078e5a0447 (DEFAULT_TABLE table=test-table [id=fbf2e1287ef14919977c4f219cb34e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:17.936165 17961 tablet_service.cc:1467] Processing CreateTablet for tablet cc97c0f0cc524e6e860926078e5a0447 (DEFAULT_TABLE table=test-table [id=fbf2e1287ef14919977c4f219cb34e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:17.936358 18167 tablet_service.cc:1467] Processing CreateTablet for tablet cc97c0f0cc524e6e860926078e5a0447 (DEFAULT_TABLE table=test-table [id=fbf2e1287ef14919977c4f219cb34e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:17.937855 18364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc97c0f0cc524e6e860926078e5a0447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:17.937865 18167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc97c0f0cc524e6e860926078e5a0447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:17.937906 17961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc97c0f0cc524e6e860926078e5a0447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:17.953624 18486 tablet_bootstrap.cc:492] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: Bootstrap starting.
I20260807 10:43:17.957669 18486 tablet_bootstrap.cc:654] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:17.958850 18486 log.cc:824] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:17.960028 18488 tablet_bootstrap.cc:492] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: Bootstrap starting.
I20260807 10:43:17.960029 18487 tablet_bootstrap.cc:492] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: Bootstrap starting.
I20260807 10:43:17.963235 18486 tablet_bootstrap.cc:492] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: No bootstrap required, opened a new log
I20260807 10:43:17.963587 18486 ts_tablet_manager.cc:1397] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260807 10:43:17.964176 18488 tablet_bootstrap.cc:654] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:17.965433 18487 tablet_bootstrap.cc:654] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:17.966707 18488 log.cc:824] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:17.966964 18487 log.cc:824] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:17.973272 18486 raft_consensus.cc:348] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba638523dbd048b89a13ba11364484a3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 34899 } } peers { permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 } } peers { permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 } }
I20260807 10:43:17.973865 18486 raft_consensus.cc:374] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:17.973996 18486 raft_consensus.cc:729] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4847c20255224b7da7ecbcb3acfa1bd6, State: Initialized, Role: FOLLOWER
I20260807 10:43:17.974674 18486 consensus_queue.cc:260] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba638523dbd048b89a13ba11364484a3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 34899 } } peers { permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 } } peers { permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 } }
I20260807 10:43:17.975777 18488 tablet_bootstrap.cc:492] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: No bootstrap required, opened a new log
I20260807 10:43:17.975771 18487 tablet_bootstrap.cc:492] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: No bootstrap required, opened a new log
I20260807 10:43:17.975878 18458 heartbeater.cc:503] Master 127.11.46.190:41337 was elected leader, sending a full tablet report...
I20260807 10:43:17.976123 18488 ts_tablet_manager.cc:1397] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.005s
I20260807 10:43:17.976125 18487 ts_tablet_manager.cc:1397] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.008s
I20260807 10:43:17.976742 18486 ts_tablet_manager.cc:1428] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260807 10:43:17.987581 18488 raft_consensus.cc:348] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba638523dbd048b89a13ba11364484a3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 34899 } } peers { permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 } } peers { permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 } }
I20260807 10:43:17.987582 18487 raft_consensus.cc:348] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba638523dbd048b89a13ba11364484a3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 34899 } } peers { permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 } } peers { permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 } }
I20260807 10:43:17.988168 18488 raft_consensus.cc:374] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:17.988161 18487 raft_consensus.cc:374] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:17.988282 18488 raft_consensus.cc:729] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd79d6aa7be547fca4a2548ea043788f, State: Initialized, Role: FOLLOWER
I20260807 10:43:17.988282 18487 raft_consensus.cc:729] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba638523dbd048b89a13ba11364484a3, State: Initialized, Role: FOLLOWER
I20260807 10:43:17.989044 18488 consensus_queue.cc:260] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba638523dbd048b89a13ba11364484a3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 34899 } } peers { permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 } } peers { permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 } }
I20260807 10:43:17.989044 18487 consensus_queue.cc:260] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba638523dbd048b89a13ba11364484a3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 34899 } } peers { permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 } } peers { permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 } }
I20260807 10:43:17.990437 18262 heartbeater.cc:503] Master 127.11.46.190:41337 was elected leader, sending a full tablet report...
I20260807 10:43:17.991339 18488 ts_tablet_manager.cc:1428] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: Time spent starting tablet: real 0.015s user 0.011s sys 0.003s
I20260807 10:43:17.991483 18487 ts_tablet_manager.cc:1428] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
W20260807 10:43:18.075579 18459 tablet.cc:2369] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:18.098766 18496 raft_consensus.cc:482] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:43:18.099102 18496 raft_consensus.cc:504] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba638523dbd048b89a13ba11364484a3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 34899 } } peers { permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 } } peers { permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 } }
I20260807 10:43:18.101094 18496 leader_election.cc:288] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4847c20255224b7da7ecbcb3acfa1bd6 (127.11.46.131:33283), fd79d6aa7be547fca4a2548ea043788f (127.11.46.130:43637)
I20260807 10:43:18.109081 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:18.101577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:54609 (local address 127.11.46.131:33283)
0807 10:43:18.101822 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:18.101830 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:18.102714 (+ 884us) server_negotiation.cc:407] Connection header received
0807 10:43:18.102878 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:18.102882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:18.102946 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:18.103021 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:18.103722 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.104755 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.107159 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.107988 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.108160 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:18.108246 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:18.108659 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 10:43:18.108803 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 10:43:18.109230 18500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:18.101632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:33283 (local address 127.11.46.129:54609)
0807 10:43:18.102593 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:18.102611 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:18.102742 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:18.103062 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:18.103066 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:18.103111 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:18.103513 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:18.103525 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.104888 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.104893 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:18.106957 (+ 2064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:18.106978 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.108264 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.108272 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:18.108474 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:18.108515 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 10:43:18.108598 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 10:43:18.108747 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"mutex_wait_us":128,"thread_start_us":642,"threads_started":1}
I20260807 10:43:18.109557 18485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:18.101845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:44525 (local address 127.11.46.130:43637)
0807 10:43:18.102086 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:18.102092 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:18.102495 (+ 403us) server_negotiation.cc:407] Connection header received
0807 10:43:18.102766 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:18.102771 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:18.102838 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:18.102912 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:18.103549 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.104679 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.107162 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.107988 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.108152 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:18.108242 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:18.108708 (+ 466us) server_negotiation.cc:299] Negotiation successful
0807 10:43:18.108851 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 10:43:18.109586 18499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:18.101584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:43637 (local address 127.11.46.129:44525)
0807 10:43:18.102356 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:18.102377 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:18.102610 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:18.102948 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:18.102952 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:18.102978 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:18.103385 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:18.103401 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.104848 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.104854 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:18.106970 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:18.106985 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.108308 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.108313 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:18.108528 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:18.108555 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 10:43:18.108651 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 10:43:18.108798 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"mutex_wait_us":212,"thread_start_us":444,"threads_started":1}
I20260807 10:43:18.110463 18390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc97c0f0cc524e6e860926078e5a0447" candidate_uuid: "ba638523dbd048b89a13ba11364484a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" is_pre_election: true
I20260807 10:43:18.110498 18195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc97c0f0cc524e6e860926078e5a0447" candidate_uuid: "ba638523dbd048b89a13ba11364484a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd79d6aa7be547fca4a2548ea043788f" is_pre_election: true
I20260807 10:43:18.111018 18195 raft_consensus.cc:2454] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba638523dbd048b89a13ba11364484a3 in term 0.
I20260807 10:43:18.111027 18390 raft_consensus.cc:2454] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba638523dbd048b89a13ba11364484a3 in term 0.
I20260807 10:43:18.111763 17896 leader_election.cc:302] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4847c20255224b7da7ecbcb3acfa1bd6, ba638523dbd048b89a13ba11364484a3; no voters:
I20260807 10:43:18.112198 18496 raft_consensus.cc:2781] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:43:18.112381 18496 raft_consensus.cc:482] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:43:18.112494 18496 raft_consensus.cc:3037] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:18.115160 18496 raft_consensus.cc:504] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba638523dbd048b89a13ba11364484a3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 34899 } } peers { permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 } } peers { permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 } }
I20260807 10:43:18.115852 18496 leader_election.cc:288] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [CANDIDATE]: Term 1 election: Requested vote from peers 4847c20255224b7da7ecbcb3acfa1bd6 (127.11.46.131:33283), fd79d6aa7be547fca4a2548ea043788f (127.11.46.130:43637)
I20260807 10:43:18.116392 18390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc97c0f0cc524e6e860926078e5a0447" candidate_uuid: "ba638523dbd048b89a13ba11364484a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4847c20255224b7da7ecbcb3acfa1bd6"
I20260807 10:43:18.116474 18195 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc97c0f0cc524e6e860926078e5a0447" candidate_uuid: "ba638523dbd048b89a13ba11364484a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd79d6aa7be547fca4a2548ea043788f"
I20260807 10:43:18.116622 18390 raft_consensus.cc:3037] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:18.116695 18195 raft_consensus.cc:3037] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:18.119092 18390 raft_consensus.cc:2454] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba638523dbd048b89a13ba11364484a3 in term 1.
I20260807 10:43:18.119195 18195 raft_consensus.cc:2454] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba638523dbd048b89a13ba11364484a3 in term 1.
I20260807 10:43:18.119657 17896 leader_election.cc:302] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4847c20255224b7da7ecbcb3acfa1bd6, ba638523dbd048b89a13ba11364484a3; no voters:
I20260807 10:43:18.120025 18496 raft_consensus.cc:2781] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:18.120746 18496 raft_consensus.cc:686] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 1 LEADER]: Becoming Leader. State: Replica: ba638523dbd048b89a13ba11364484a3, State: Running, Role: LEADER
I20260807 10:43:18.121347 18496 consensus_queue.cc:237] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba638523dbd048b89a13ba11364484a3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 34899 } } peers { permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 } } peers { permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 } }
I20260807 10:43:18.126339 17756 catalog_manager.cc:5495] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba638523dbd048b89a13ba11364484a3 (127.11.46.129). New cstate: current_term: 1 leader_uuid: "ba638523dbd048b89a13ba11364484a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba638523dbd048b89a13ba11364484a3" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 } health_report { overall_health: UNKNOWN } } }
W20260807 10:43:18.164593 18066 tablet.cc:2369] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:18.174189 18480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:18.168621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55808 (local address 127.11.46.129:34899)
0807 10:43:18.168805 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:18.168810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:18.168830 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:43:18.169038 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:18.169042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:18.169130 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:18.169257 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:18.169724 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.170459 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.171894 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.172320 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.172436 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:18.173050 (+ 614us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:18.173666 (+ 616us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:18.173790 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:18.173886 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 10:43:18.173968 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:43:18.183332 18390 raft_consensus.cc:1261] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6 [term 1 FOLLOWER]: Refusing update from remote peer ba638523dbd048b89a13ba11364484a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:18.183332 18195 raft_consensus.cc:1261] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f [term 1 FOLLOWER]: Refusing update from remote peer ba638523dbd048b89a13ba11364484a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:18.184618 18501 consensus_queue.cc:1035] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4847c20255224b7da7ecbcb3acfa1bd6" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 33283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:18.185037 18496 consensus_queue.cc:1035] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd79d6aa7be547fca4a2548ea043788f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:18.215440 17756 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:18.215729 17756 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:18.219945 17756 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 167be35ac6a44346b04ee6d6dfa70443: Sending DeleteTablet for 3 replicas of tablet cc97c0f0cc524e6e860926078e5a0447
I20260807 10:43:18.221355 18364 tablet_service.cc:1514] Processing DeleteTablet for tablet cc97c0f0cc524e6e860926078e5a0447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:18 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:33238
I20260807 10:43:18.221357 17961 tablet_service.cc:1514] Processing DeleteTablet for tablet cc97c0f0cc524e6e860926078e5a0447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:18 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:55802
I20260807 10:43:18.221343 18167 tablet_service.cc:1514] Processing DeleteTablet for tablet cc97c0f0cc524e6e860926078e5a0447 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:18 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:49272
I20260807 10:43:18.222690 18519 tablet_replica.cc:330] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: stopping tablet replica
I20260807 10:43:18.223294 18519 raft_consensus.cc:2229] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:18.223507 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 17865
I20260807 10:43:18.223958 18519 raft_consensus.cc:2258] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:18.224852 18521 tablet_replica.cc:330] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: stopping tablet replica
I20260807 10:43:18.225320 18521 raft_consensus.cc:2229] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:18.225929 18520 tablet_replica.cc:330] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: stopping tablet replica
I20260807 10:43:18.226460 18520 raft_consensus.cc:2229] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:43:18.227303 18520 raft_consensus.cc:2258] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:18.227967 18521 raft_consensus.cc:2258] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:18.228399 18519 ts_tablet_manager.cc:1905] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:18.230636 18521 ts_tablet_manager.cc:1905] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:18.232877 18520 ts_tablet_manager.cc:1905] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:18.236364 18519 ts_tablet_manager.cc:1918] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:18.236745 18519 log.cc:1196] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/cc97c0f0cc524e6e860926078e5a0447
I20260807 10:43:18.237432 18519 ts_tablet_manager.cc:1939] T cc97c0f0cc524e6e860926078e5a0447 P 4847c20255224b7da7ecbcb3acfa1bd6: Deleting consensus metadata
I20260807 10:43:18.239900 17740 catalog_manager.cc:4841] TS 4847c20255224b7da7ecbcb3acfa1bd6 (127.11.46.131:33283): tablet cc97c0f0cc524e6e860926078e5a0447 (table test-table [id=fbf2e1287ef14919977c4f219cb34e7f]) successfully deleted
I20260807 10:43:18.247004 18520 ts_tablet_manager.cc:1918] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 07 10:43:18 dist-test-slave-42z9 krb5kdc[17689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:43:18.249626 18520 log.cc:1196] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/cc97c0f0cc524e6e860926078e5a0447
I20260807 10:43:18.250185 18520 ts_tablet_manager.cc:1939] T cc97c0f0cc524e6e860926078e5a0447 P ba638523dbd048b89a13ba11364484a3: Deleting consensus metadata
I20260807 10:43:18.252130 18521 ts_tablet_manager.cc:1918] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:18.252372 18521 log.cc:1196] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/cc97c0f0cc524e6e860926078e5a0447
I20260807 10:43:18.252331 17738 catalog_manager.cc:4841] TS ba638523dbd048b89a13ba11364484a3 (127.11.46.129:34899): tablet cc97c0f0cc524e6e860926078e5a0447 (table test-table [id=fbf2e1287ef14919977c4f219cb34e7f]) successfully deleted
I20260807 10:43:18.253022 18521 ts_tablet_manager.cc:1939] T cc97c0f0cc524e6e860926078e5a0447 P fd79d6aa7be547fca4a2548ea043788f: Deleting consensus metadata
I20260807 10:43:18.255386 17739 catalog_manager.cc:4841] TS fd79d6aa7be547fca4a2548ea043788f (127.11.46.130:43637): tablet cc97c0f0cc524e6e860926078e5a0447 (table test-table [id=fbf2e1287ef14919977c4f219cb34e7f]) successfully deleted
I20260807 10:43:18.259649 18480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:18.225573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55818 (local address 127.11.46.129:34899)
0807 10:43:18.225787 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:18.225794 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:18.238151 (+ 12357us) server_negotiation.cc:407] Connection header received
0807 10:43:18.238627 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:18.238633 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:18.238730 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:18.238812 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:18.240756 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.242081 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.243962 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.244743 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.244893 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:18.250729 (+ 5836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:18.250745 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:18.250769 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:18.250826 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:18.255229 (+ 4403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:18.256400 (+ 1171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:18.256411 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:18.256415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:18.256659 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:18.257231 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:18.257238 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:18.257241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:18.258075 (+ 834us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:18.258564 (+ 489us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:18.258883 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 10:43:18.259196 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:43:18.260454 18057 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:18.363216 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 17865
I20260807 10:43:18.394680 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 18072
Aug 07 10:43:18 dist-test-slave-42z9 krb5kdc[17689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:43:18.410758 18485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:18.395567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49276 (local address 127.11.46.130:43637)
0807 10:43:18.395780 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:18.395786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:18.395810 (+ 24us) server_negotiation.cc:407] Connection header received
0807 10:43:18.395942 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:18.395947 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:18.396019 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:18.396109 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:18.397432 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.398269 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.399690 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.400118 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.400250 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:18.404784 (+ 4534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:18.404806 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:18.404828 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:18.404882 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:18.407953 (+ 3071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:18.408737 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:18.408745 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:18.408748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:18.408928 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:18.409247 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:18.409250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:18.409252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:18.409772 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:18.410033 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:18.410281 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 10:43:18.410479 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:43:18.411554 18251 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:18.505558 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 18072
I20260807 10:43:18.540650 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 18271
Aug 07 10:43:18 dist-test-slave-42z9 krb5kdc[17689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:43:18.557355 18484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:18.541572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33254 (local address 127.11.46.131:33283)
0807 10:43:18.541771 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:18.541777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:18.541802 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:43:18.542032 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:18.542036 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:18.542103 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:18.542202 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:18.543499 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.544255 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.546066 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:18.546489 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:18.546615 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:18.551249 (+ 4634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:18.551270 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:18.551291 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:18.551340 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:18.554143 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:18.555021 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:18.555032 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:18.555035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:18.555215 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:18.555657 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:18.555661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:18.555663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:18.556083 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:18.556412 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:18.556739 (+ 327us) server_negotiation.cc:299] Negotiation successful
0807 10:43:18.556989 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:43:18.558072 18451 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:18.650334 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 18271
I20260807 10:43:18.679606 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 17710
I20260807 10:43:18.680848 17812 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:18.796056 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 17710
2026-08-07T10:43:18Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4780 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T10:43:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:18Z Disabled control of system clock
I20260807 10:43:18.891814 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35157
--webserver_interface=127.11.46.190
--webserver_port=0
--builtin_ntp_servers=127.11.46.148:43669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:35157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 10:43:19.287609 18536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:19.287988 18536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:19.288081 18536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:19.295811 18536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:19.295969 18536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:19.296010 18536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:19.296062 18536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:19.296108 18536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:19.306095 18536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:43669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:35157
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:19.307611 18536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:19.309707 18536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:19.322548 18543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:19.322472 18545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:19.322533 18542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:19.323520 18536 server_base.cc:1034] running on GCE node
I20260807 10:43:19.324427 18536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:19.326077 18536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:19.327301 18536 hybrid_clock.cc:648] HybridClock initialized: now 1786099399327251 us; error 39 us; skew 500 ppm
I20260807 10:43:19.327706 18536 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:43:19.330255 18536 webserver.cc:460] Webserver started at http://127.11.46.190:45783/ using document root <none> and password file <none>
I20260807 10:43:19.331049 18536 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:19.331157 18536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:19.331518 18536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:19.334944 18536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "baf38cc525784dcda077ac5089dfc597"
format_stamp: "Formatted at 2026-08-07 10:43:19 on dist-test-slave-42z9"
server_key: "3b9ac8eda9bb2c54460659bbcdde70f6"
server_key_iv: "3e9089c5f6a8088619eb67d5de844aa0"
server_key_version: "encryptionkey@0"
I20260807 10:43:19.335875 18536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "baf38cc525784dcda077ac5089dfc597"
format_stamp: "Formatted at 2026-08-07 10:43:19 on dist-test-slave-42z9"
server_key: "3b9ac8eda9bb2c54460659bbcdde70f6"
server_key_iv: "3e9089c5f6a8088619eb67d5de844aa0"
server_key_version: "encryptionkey@0"
I20260807 10:43:19.342068 18536 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 10:43:19.346354 18552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:19.347968 18536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:43:19.348186 18536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "baf38cc525784dcda077ac5089dfc597"
format_stamp: "Formatted at 2026-08-07 10:43:19 on dist-test-slave-42z9"
server_key: "3b9ac8eda9bb2c54460659bbcdde70f6"
server_key_iv: "3e9089c5f6a8088619eb67d5de844aa0"
server_key_version: "encryptionkey@0"
I20260807 10:43:19.348433 18536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:19.354772 18536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:19.355705 18536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:19.356010 18536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:19.375125 18536 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:35157
I20260807 10:43:19.375144 18643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:35157 every 8 connection(s)
I20260807 10:43:19.376763 18536 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:19.381093 18644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:19.384260 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 18536
I20260807 10:43:19.384476 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:19.385330 11450 external_mini_cluster.cc:1428] Setting key 11b0e2c78391067e6c2c7391e7f45adc
I20260807 10:43:19.395185 18644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597: Bootstrap starting.
I20260807 10:43:19.395185 18647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:19.387934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50838 (local address 127.11.46.190:35157)
0807 10:43:19.389185 (+ 1251us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:19.389200 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:19.389254 (+ 54us) server_negotiation.cc:407] Connection header received
0807 10:43:19.391147 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:19.391178 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:19.391711 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:19.392163 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:19.393286 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:19.393292 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:19.393307 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:19.393326 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:19.393390 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:19.393407 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:19.393686 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:19.393835 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 10:43:19.394143 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":431,"threads_started":1}
I20260807 10:43:19.399185 18644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:19.400375 18644 log.cc:824] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:19.403723 18644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597: No bootstrap required, opened a new log
I20260807 10:43:19.412097 18644 raft_consensus.cc:348] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf38cc525784dcda077ac5089dfc597" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35157 } }
I20260807 10:43:19.412588 18644 raft_consensus.cc:374] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:19.412695 18644 raft_consensus.cc:729] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baf38cc525784dcda077ac5089dfc597, State: Initialized, Role: FOLLOWER
I20260807 10:43:19.413496 18644 consensus_queue.cc:260] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf38cc525784dcda077ac5089dfc597" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35157 } }
I20260807 10:43:19.413857 18644 raft_consensus.cc:388] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:19.414033 18644 raft_consensus.cc:482] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:19.414232 18644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:19.416775 18644 raft_consensus.cc:504] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf38cc525784dcda077ac5089dfc597" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35157 } }
I20260807 10:43:19.417425 18644 leader_election.cc:302] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: baf38cc525784dcda077ac5089dfc597; no voters:
I20260807 10:43:19.418161 18644 leader_election.cc:288] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:19.418332 18651 raft_consensus.cc:2781] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:19.419124 18651 raft_consensus.cc:686] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [term 1 LEADER]: Becoming Leader. State: Replica: baf38cc525784dcda077ac5089dfc597, State: Running, Role: LEADER
I20260807 10:43:19.419759 18651 consensus_queue.cc:237] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf38cc525784dcda077ac5089dfc597" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35157 } }
I20260807 10:43:19.420501 18644 sys_catalog.cc:564] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:19.422762 18652 sys_catalog.cc:455] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "baf38cc525784dcda077ac5089dfc597" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf38cc525784dcda077ac5089dfc597" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35157 } } }
I20260807 10:43:19.423180 18652 sys_catalog.cc:458] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:19.423696 18653 sys_catalog.cc:455] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [sys.catalog]: SysCatalogTable state changed. Reason: New leader baf38cc525784dcda077ac5089dfc597. Latest consensus state: current_term: 1 leader_uuid: "baf38cc525784dcda077ac5089dfc597" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf38cc525784dcda077ac5089dfc597" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35157 } } }
I20260807 10:43:19.424019 18653 sys_catalog.cc:458] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:19.425963 18657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:19.431618 18657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:19.442677 18657 catalog_manager.cc:1347] Generated new cluster ID: ad87ebc3bf07469b8553246b7dfae0f5
I20260807 10:43:19.442829 18657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:19.459827 18657 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:19.460358 18657 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:19.475929 18657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597: Generated new TSK 0
I20260807 10:43:19.476910 18657 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:43:19.485101 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35157
--builtin_ntp_servers=127.11.46.148:43669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 10:43:19.868618 18676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:19.868971 18676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:19.869108 18676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:19.876773 18676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:19.876906 18676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:19.877072 18676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:19.886839 18676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:43669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:19.888315 18676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:19.890609 18676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:19.905965 18686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:19.906071 18685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:19.906344 18691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:19.907159 18676 server_base.cc:1034] running on GCE node
I20260807 10:43:19.907922 18676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:19.909034 18676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:19.910274 18676 hybrid_clock.cc:648] HybridClock initialized: now 1786099399910209 us; error 59 us; skew 500 ppm
I20260807 10:43:19.910653 18676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:43:19.913249 18676 webserver.cc:460] Webserver started at http://127.11.46.129:46679/ using document root <none> and password file <none>
I20260807 10:43:19.914084 18676 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:19.914197 18676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:19.914553 18676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:19.917870 18676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "5344792d16e34f338874d0dcabfa823a"
format_stamp: "Formatted at 2026-08-07 10:43:19 on dist-test-slave-42z9"
server_key: "af84298694eb806c55323bcfa312d116"
server_key_iv: "d7be1e0c77c189fff804c34c41360e36"
server_key_version: "encryptionkey@0"
I20260807 10:43:19.918797 18676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "5344792d16e34f338874d0dcabfa823a"
format_stamp: "Formatted at 2026-08-07 10:43:19 on dist-test-slave-42z9"
server_key: "af84298694eb806c55323bcfa312d116"
server_key_iv: "d7be1e0c77c189fff804c34c41360e36"
server_key_version: "encryptionkey@0"
I20260807 10:43:19.925065 18676 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:43:19.929294 18699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:19.930823 18676 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 10:43:19.931043 18676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "5344792d16e34f338874d0dcabfa823a"
format_stamp: "Formatted at 2026-08-07 10:43:19 on dist-test-slave-42z9"
server_key: "af84298694eb806c55323bcfa312d116"
server_key_iv: "d7be1e0c77c189fff804c34c41360e36"
server_key_version: "encryptionkey@0"
I20260807 10:43:19.931283 18676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:19.937427 18676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:19.938412 18676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:19.938699 18676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:19.939738 18676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:19.941403 18676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:19.941548 18676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 10:43:19.941668 18676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:19.941740 18676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:19.974704 18676 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:33051
I20260807 10:43:19.974807 18868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:33051 every 8 connection(s)
I20260807 10:43:19.976192 18676 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:19.984668 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 18676
I20260807 10:43:19.984879 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:43:19.984901 18873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:19.978901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:37101 (local address 127.11.46.190:35157)
0807 10:43:19.979360 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:19.979365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:19.980747 (+ 1382us) server_negotiation.cc:407] Connection header received
0807 10:43:19.982567 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:19.982573 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:19.982643 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:19.982741 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:19.984080 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:19.984084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:19.984088 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:19.984106 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:19.984155 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:19.984167 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:19.984290 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:19.984480 (+ 190us) server_negotiation.cc:299] Negotiation successful
0807 10:43:19.984560 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":224,"threads_started":1}
I20260807 10:43:19.985668 11450 external_mini_cluster.cc:1428] Setting key 85ae03acbec1aa467f1811e58938fb3c
I20260807 10:43:19.986008 18874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:19.979585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35157 (local address 127.11.46.129:37101)
0807 10:43:19.980565 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:19.980612 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:19.982280 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:19.983001 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:19.983010 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:19.983107 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:19.983761 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:43:19.983764 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:19.983804 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:43:19.983897 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:19.984261 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:19.984274 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:19.984281 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 10:43:19.984569 (+ 288us) client_negotiation.cc:240] Negotiation successful
0807 10:43:19.984856 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":284,"threads_started":1}
I20260807 10:43:19.987651 18871 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35157
I20260807 10:43:19.988049 18871 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:19.988837 18871 heartbeater.cc:511] Master 127.11.46.190:35157 requested a full tablet report, sending...
I20260807 10:43:19.988940 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35157
--builtin_ntp_servers=127.11.46.148:43669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 10:43:19.991505 18588 ts_manager.cc:194] Registered new tserver with Master: 5344792d16e34f338874d0dcabfa823a (127.11.46.129:33051)
W20260807 10:43:20.368225 18876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:20.368566 18876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:20.368707 18876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:20.376473 18876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:20.376612 18876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:20.376797 18876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:20.387039 18876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:43669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:20.388597 18876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:20.390700 18876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:20.405707 18882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:20.405685 18883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:20.405727 18886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:20.406621 18876 server_base.cc:1034] running on GCE node
I20260807 10:43:20.407320 18876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:20.408391 18876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:20.409605 18876 hybrid_clock.cc:648] HybridClock initialized: now 1786099400409538 us; error 60 us; skew 500 ppm
I20260807 10:43:20.409983 18876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:43:20.412887 18876 webserver.cc:460] Webserver started at http://127.11.46.130:33907/ using document root <none> and password file <none>
I20260807 10:43:20.413827 18876 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:20.413945 18876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:20.414328 18876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:20.417690 18876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "5784b7560e644425a1692c5f884f2537"
format_stamp: "Formatted at 2026-08-07 10:43:20 on dist-test-slave-42z9"
server_key: "ffa0be3a60e4f5976c4f778de4963894"
server_key_iv: "2438092f56df3c02d04cc985a9e79f68"
server_key_version: "encryptionkey@0"
I20260807 10:43:20.418684 18876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "5784b7560e644425a1692c5f884f2537"
format_stamp: "Formatted at 2026-08-07 10:43:20 on dist-test-slave-42z9"
server_key: "ffa0be3a60e4f5976c4f778de4963894"
server_key_iv: "2438092f56df3c02d04cc985a9e79f68"
server_key_version: "encryptionkey@0"
I20260807 10:43:20.425256 18876 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:43:20.429795 18894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:20.431420 18876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:43:20.431638 18876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "5784b7560e644425a1692c5f884f2537"
format_stamp: "Formatted at 2026-08-07 10:43:20 on dist-test-slave-42z9"
server_key: "ffa0be3a60e4f5976c4f778de4963894"
server_key_iv: "2438092f56df3c02d04cc985a9e79f68"
server_key_version: "encryptionkey@0"
I20260807 10:43:20.431910 18876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:20.438807 18876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:20.439814 18876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:20.440119 18876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:20.441239 18876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:20.443014 18876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:20.443140 18876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:20.443264 18876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:20.443333 18876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:20.484054 18876 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:35875
I20260807 10:43:20.484097 19066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:35875 every 8 connection(s)
I20260807 10:43:20.485785 18876 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:20.489836 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 18876
I20260807 10:43:20.490002 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:43:20.490612 11450 external_mini_cluster.cc:1428] Setting key d58a94104acedfbd46655da7cebc12be
I20260807 10:43:20.494179 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35157
--builtin_ntp_servers=127.11.46.148:43669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 10:43:20.496721 19072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:20.489045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:58309 (local address 127.11.46.190:35157)
0807 10:43:20.489625 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:20.489632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:20.491372 (+ 1740us) server_negotiation.cc:407] Connection header received
0807 10:43:20.493580 (+ 2208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:20.493584 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:20.493643 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:20.493738 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:20.495649 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:20.495657 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:20.495662 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:20.495726 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:20.495817 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:20.495836 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:20.496036 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:20.496353 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 10:43:20.496447 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":254,"threads_started":1}
I20260807 10:43:20.498143 19073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:20.489799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35157 (local address 127.11.46.130:58309)
0807 10:43:20.491135 (+ 1336us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:20.491204 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:20.493205 (+ 2001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:20.494051 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:20.494066 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:20.494224 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:20.495063 (+ 839us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:43:20.495067 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:20.495132 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:43:20.495274 (+ 142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:20.496007 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:20.496022 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:20.496031 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 10:43:20.496395 (+ 364us) client_negotiation.cc:240] Negotiation successful
0807 10:43:20.496751 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":362,"threads_started":1}
I20260807 10:43:20.499848 19067 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35157
I20260807 10:43:20.500205 19067 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:20.500896 19067 heartbeater.cc:511] Master 127.11.46.190:35157 requested a full tablet report, sending...
I20260807 10:43:20.502696 18588 ts_manager.cc:194] Registered new tserver with Master: 5784b7560e644425a1692c5f884f2537 (127.11.46.130:35875)
W20260807 10:43:20.883617 19075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:20.883966 19075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:20.884106 19075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:20.891834 19075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:20.891971 19075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:20.892124 19075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:20.901996 19075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:43669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:20.903527 19075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:20.905737 19075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:20.920416 19082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:20.920416 19083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:20.920710 19087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:20.921547 19075 server_base.cc:1034] running on GCE node
I20260807 10:43:20.922307 19075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:20.923455 19075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:20.924702 19075 hybrid_clock.cc:648] HybridClock initialized: now 1786099400924630 us; error 56 us; skew 500 ppm
I20260807 10:43:20.925064 19075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:43:20.927675 19075 webserver.cc:460] Webserver started at http://127.11.46.131:34641/ using document root <none> and password file <none>
I20260807 10:43:20.928483 19075 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:20.928601 19075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:20.928964 19075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:20.932245 19075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "404d864cbcf24ac89deb55459c3a29c2"
format_stamp: "Formatted at 2026-08-07 10:43:20 on dist-test-slave-42z9"
server_key: "05cc0b02a60fd0458a95310229ba9d5c"
server_key_iv: "742b58ca183f13f8589ed820363719cf"
server_key_version: "encryptionkey@0"
I20260807 10:43:20.933169 19075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "404d864cbcf24ac89deb55459c3a29c2"
format_stamp: "Formatted at 2026-08-07 10:43:20 on dist-test-slave-42z9"
server_key: "05cc0b02a60fd0458a95310229ba9d5c"
server_key_iv: "742b58ca183f13f8589ed820363719cf"
server_key_version: "encryptionkey@0"
I20260807 10:43:20.939477 19075 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260807 10:43:20.943964 19098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:20.945729 19075 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:20.945935 19075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "404d864cbcf24ac89deb55459c3a29c2"
format_stamp: "Formatted at 2026-08-07 10:43:20 on dist-test-slave-42z9"
server_key: "05cc0b02a60fd0458a95310229ba9d5c"
server_key_iv: "742b58ca183f13f8589ed820363719cf"
server_key_version: "encryptionkey@0"
I20260807 10:43:20.946192 19075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:20.953696 19075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:20.955053 19075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:20.955394 19075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:20.956533 19075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:20.958325 19075 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:20.958467 19075 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:20.958595 19075 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:20.958678 19075 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:20.995101 18871 heartbeater.cc:503] Master 127.11.46.190:35157 was elected leader, sending a full tablet report...
I20260807 10:43:20.998919 19075 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:36549
I20260807 10:43:20.998921 19269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:36549 every 8 connection(s)
I20260807 10:43:21.000487 19075 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:21.005695 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 19075
I20260807 10:43:21.005879 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:43:21.006326 11450 external_mini_cluster.cc:1428] Setting key 2fe621288c25fa6fa0bf1b280390b776
I20260807 10:43:21.010350 19274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.003642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:40659 (local address 127.11.46.190:35157)
0807 10:43:21.004374 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.004381 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.005584 (+ 1203us) server_negotiation.cc:407] Connection header received
0807 10:43:21.007580 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.007586 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.007663 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.007776 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.009342 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.009350 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.009355 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.009380 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.009486 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.009507 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.009640 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.009985 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.010061 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":413,"threads_started":1}
I20260807 10:43:21.011371 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.004098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35157 (local address 127.11.46.131:40659)
0807 10:43:21.005332 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.005395 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:21.007217 (+ 1822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:21.008103 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:21.008113 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:21.008224 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:21.008985 (+ 761us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:43:21.008988 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:21.009044 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:43:21.009150 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:21.009709 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:21.009723 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:21.009733 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 10:43:21.010032 (+ 299us) client_negotiation.cc:240] Negotiation successful
0807 10:43:21.010276 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":364,"threads_started":1}
I20260807 10:43:21.013226 19270 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35157
I20260807 10:43:21.013610 19270 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:21.014302 19270 heartbeater.cc:511] Master 127.11.46.190:35157 requested a full tablet report, sending...
I20260807 10:43:21.016037 18588 ts_manager.cc:194] Registered new tserver with Master: 404d864cbcf24ac89deb55459c3a29c2 (127.11.46.131:36549)
I20260807 10:43:21.022917 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:43:21.030431 19274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.027782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36990 (local address 127.11.46.190:35157)
0807 10:43:21.027995 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.028002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.028414 (+ 412us) server_negotiation.cc:407] Connection header received
0807 10:43:21.028616 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.028622 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.028685 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.028774 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.029792 (+ 1018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.029798 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.029803 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.029822 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.029856 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.029868 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.029984 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.030088 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.030156 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:43:21.034948 18588 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36990:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:43:21.042553 18588 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:43:21.078462 19288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.058374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57844 (local address 127.11.46.129:33051)
0807 10:43:21.073975 (+ 15601us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.073984 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.074245 (+ 261us) server_negotiation.cc:407] Connection header received
0807 10:43:21.074532 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.074543 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.074778 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.074958 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.077012 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.077022 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.077035 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.077055 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.077121 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.077146 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.077316 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.077970 (+ 654us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.078090 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15415,"thread_start_us":15089,"threads_started":1}
I20260807 10:43:21.078492 19290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.059186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40110 (local address 127.11.46.131:36549)
0807 10:43:21.071639 (+ 12453us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.071651 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.073272 (+ 1621us) server_negotiation.cc:407] Connection header received
0807 10:43:21.073373 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.073382 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.073685 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.073860 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.076539 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.076550 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.076586 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.076608 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.076676 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.076700 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.076883 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.077970 (+ 1087us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.078104 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12170,"thread_start_us":13773,"threads_started":1}
I20260807 10:43:21.078763 19287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.058844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:36549 (local address 127.0.0.1:40110)
0807 10:43:21.073034 (+ 14190us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.073053 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:21.073188 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:21.075617 (+ 2429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:21.075622 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:21.075651 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:21.076278 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:43:21.076280 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:21.076294 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:43:21.076342 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:21.076978 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:21.076991 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:21.077000 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 10:43:21.077211 (+ 211us) client_negotiation.cc:240] Negotiation successful
0807 10:43:21.077334 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14019,"thread_start_us":13079,"threads_started":1}
I20260807 10:43:21.078934 19289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.058173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33051 (local address 127.0.0.1:57844)
0807 10:43:21.072530 (+ 14357us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.072607 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:21.072841 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:21.075251 (+ 2410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:21.075259 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:21.075357 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:21.076215 (+ 858us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:43:21.076219 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:21.076258 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:43:21.076344 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:21.077373 (+ 1029us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:21.077378 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:21.077387 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 10:43:21.077562 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 10:43:21.077616 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13995,"thread_start_us":15088,"threads_started":1}
I20260807 10:43:21.080243 19292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.074092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42772 (local address 127.11.46.130:35875)
0807 10:43:21.074663 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.074670 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.075345 (+ 675us) server_negotiation.cc:407] Connection header received
0807 10:43:21.075645 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.075654 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.076315 (+ 661us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.076460 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.079218 (+ 2758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.079229 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.079244 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.079268 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.079363 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.079398 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.079525 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.079811 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.079939 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":274,"threads_started":1}
I20260807 10:43:21.080330 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.074714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:35875 (local address 127.0.0.1:42772)
0807 10:43:21.075229 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.075246 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:21.075465 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:21.076551 (+ 1086us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:21.076556 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:21.076578 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:21.078902 (+ 2324us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:43:21.078906 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:21.078944 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:43:21.079002 (+ 58us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:21.079629 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:21.079634 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:21.079638 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 10:43:21.079777 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 10:43:21.079838 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":260,"threads_started":1}
I20260807 10:43:21.083523 19174 tablet_service.cc:1467] Processing CreateTablet for tablet b52d24950c6b48a08717b75f903a2106 (DEFAULT_TABLE table=test-table [id=29aca4be37534ade94499847e1d96981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:21.083542 18775 tablet_service.cc:1467] Processing CreateTablet for tablet b52d24950c6b48a08717b75f903a2106 (DEFAULT_TABLE table=test-table [id=29aca4be37534ade94499847e1d96981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:21.084333 18963 tablet_service.cc:1467] Processing CreateTablet for tablet b52d24950c6b48a08717b75f903a2106 (DEFAULT_TABLE table=test-table [id=29aca4be37534ade94499847e1d96981]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:21.084996 19174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b52d24950c6b48a08717b75f903a2106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:21.085044 18775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b52d24950c6b48a08717b75f903a2106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:21.085791 18963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b52d24950c6b48a08717b75f903a2106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:21.097853 19294 tablet_bootstrap.cc:492] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: Bootstrap starting.
I20260807 10:43:21.100610 19296 tablet_bootstrap.cc:492] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a: Bootstrap starting.
I20260807 10:43:21.101568 19295 tablet_bootstrap.cc:492] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: Bootstrap starting.
I20260807 10:43:21.103812 19294 tablet_bootstrap.cc:654] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:21.105335 19294 log.cc:824] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:21.105875 19295 tablet_bootstrap.cc:654] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:21.107170 19295 log.cc:824] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:21.109539 19294 tablet_bootstrap.cc:492] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: No bootstrap required, opened a new log
I20260807 10:43:21.109545 19296 tablet_bootstrap.cc:654] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:21.109947 19294 ts_tablet_manager.cc:1397] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260807 10:43:21.111023 19295 tablet_bootstrap.cc:492] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: No bootstrap required, opened a new log
I20260807 10:43:21.111445 19295 ts_tablet_manager.cc:1397] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260807 10:43:21.111668 19296 log.cc:824] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:21.115180 19296 tablet_bootstrap.cc:492] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a: No bootstrap required, opened a new log
I20260807 10:43:21.115494 19296 ts_tablet_manager.cc:1397] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.006s
I20260807 10:43:21.121650 19294 raft_consensus.cc:348] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 } } peers { permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 } } peers { permanent_uuid: "404d864cbcf24ac89deb55459c3a29c2" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 36549 } }
I20260807 10:43:21.122325 19294 raft_consensus.cc:374] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:21.122457 19294 raft_consensus.cc:729] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 404d864cbcf24ac89deb55459c3a29c2, State: Initialized, Role: FOLLOWER
I20260807 10:43:21.122476 19295 raft_consensus.cc:348] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 } } peers { permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 } } peers { permanent_uuid: "404d864cbcf24ac89deb55459c3a29c2" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 36549 } }
I20260807 10:43:21.123066 19295 raft_consensus.cc:374] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:21.123184 19295 raft_consensus.cc:729] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5784b7560e644425a1692c5f884f2537, State: Initialized, Role: FOLLOWER
I20260807 10:43:21.123473 19294 consensus_queue.cc:260] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 } } peers { permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 } } peers { permanent_uuid: "404d864cbcf24ac89deb55459c3a29c2" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 36549 } }
I20260807 10:43:21.123837 19295 consensus_queue.cc:260] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 } } peers { permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 } } peers { permanent_uuid: "404d864cbcf24ac89deb55459c3a29c2" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 36549 } }
I20260807 10:43:21.124334 19296 raft_consensus.cc:348] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 } } peers { permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 } } peers { permanent_uuid: "404d864cbcf24ac89deb55459c3a29c2" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 36549 } }
I20260807 10:43:21.124871 19270 heartbeater.cc:503] Master 127.11.46.190:35157 was elected leader, sending a full tablet report...
I20260807 10:43:21.124869 19296 raft_consensus.cc:374] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:21.124979 19296 raft_consensus.cc:729] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5344792d16e34f338874d0dcabfa823a, State: Initialized, Role: FOLLOWER
I20260807 10:43:21.125794 19294 ts_tablet_manager.cc:1428] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: Time spent starting tablet: real 0.016s user 0.014s sys 0.001s
I20260807 10:43:21.125710 19296 consensus_queue.cc:260] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 } } peers { permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 } } peers { permanent_uuid: "404d864cbcf24ac89deb55459c3a29c2" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 36549 } }
I20260807 10:43:21.127705 19295 ts_tablet_manager.cc:1428] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260807 10:43:21.127712 19296 ts_tablet_manager.cc:1428] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a: Time spent starting tablet: real 0.012s user 0.007s sys 0.006s
I20260807 10:43:21.128228 19067 heartbeater.cc:503] Master 127.11.46.190:35157 was elected leader, sending a full tablet report...
I20260807 10:43:21.193225 19301 raft_consensus.cc:482] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:43:21.193631 19301 raft_consensus.cc:504] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 } } peers { permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 } } peers { permanent_uuid: "404d864cbcf24ac89deb55459c3a29c2" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 36549 } }
I20260807 10:43:21.195566 19301 leader_election.cc:288] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5344792d16e34f338874d0dcabfa823a (127.11.46.129:33051), 5784b7560e644425a1692c5f884f2537 (127.11.46.130:35875)
I20260807 10:43:21.198683 19288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.196240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:37559 (local address 127.11.46.129:33051)
0807 10:43:21.196453 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.196459 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.196481 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:43:21.196549 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.196554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.196626 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.196735 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.198073 (+ 1338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.198078 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.198082 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.198100 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.198136 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.198149 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.198280 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.198383 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.198461 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 10:43:21.198699 19275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.195942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33051 (local address 127.11.46.131:37559)
0807 10:43:21.196152 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.196175 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:21.196284 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:21.197061 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:21.197071 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:21.197101 (+ 30us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:21.197813 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:43:21.197816 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:21.197833 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:43:21.197880 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:21.198261 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:21.198264 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:21.198269 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 10:43:21.198370 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 10:43:21.198431 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 10:43:21.199831 19292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.196790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:43015 (local address 127.11.46.130:35875)
0807 10:43:21.196971 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.196977 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.197473 (+ 496us) server_negotiation.cc:407] Connection header received
0807 10:43:21.197625 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.197630 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.197694 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.197793 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.198741 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.198747 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.198751 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.198771 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.198889 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.198932 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.199073 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.199467 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.199544 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:43:21.199956 19308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.196350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:35875 (local address 127.11.46.131:43015)
0807 10:43:21.197353 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.197372 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:21.197510 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:21.197829 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:21.197834 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:21.197859 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:21.198516 (+ 657us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:43:21.198520 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:21.198536 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:43:21.198581 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:21.199301 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:21.199305 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:21.199311 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 10:43:21.199467 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 10:43:21.199528 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"thread_start_us":637,"threads_started":1}
I20260807 10:43:21.200129 18803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b52d24950c6b48a08717b75f903a2106" candidate_uuid: "404d864cbcf24ac89deb55459c3a29c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5344792d16e34f338874d0dcabfa823a" is_pre_election: true
I20260807 10:43:21.200758 18803 raft_consensus.cc:2454] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 404d864cbcf24ac89deb55459c3a29c2 in term 0.
I20260807 10:43:21.201002 18994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b52d24950c6b48a08717b75f903a2106" candidate_uuid: "404d864cbcf24ac89deb55459c3a29c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5784b7560e644425a1692c5f884f2537" is_pre_election: true
I20260807 10:43:21.201593 18994 raft_consensus.cc:2454] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 404d864cbcf24ac89deb55459c3a29c2 in term 0.
I20260807 10:43:21.201594 19102 leader_election.cc:302] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 404d864cbcf24ac89deb55459c3a29c2, 5344792d16e34f338874d0dcabfa823a; no voters:
I20260807 10:43:21.201996 19301 raft_consensus.cc:2781] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:43:21.202162 19301 raft_consensus.cc:482] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:43:21.202278 19301 raft_consensus.cc:3037] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:21.204712 19301 raft_consensus.cc:504] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 } } peers { permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 } } peers { permanent_uuid: "404d864cbcf24ac89deb55459c3a29c2" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 36549 } }
I20260807 10:43:21.205343 19301 leader_election.cc:288] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [CANDIDATE]: Term 1 election: Requested vote from peers 5344792d16e34f338874d0dcabfa823a (127.11.46.129:33051), 5784b7560e644425a1692c5f884f2537 (127.11.46.130:35875)
I20260807 10:43:21.205977 18803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b52d24950c6b48a08717b75f903a2106" candidate_uuid: "404d864cbcf24ac89deb55459c3a29c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5344792d16e34f338874d0dcabfa823a"
I20260807 10:43:21.205977 18994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b52d24950c6b48a08717b75f903a2106" candidate_uuid: "404d864cbcf24ac89deb55459c3a29c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5784b7560e644425a1692c5f884f2537"
I20260807 10:43:21.206218 18994 raft_consensus.cc:3037] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:21.206213 18803 raft_consensus.cc:3037] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:21.209611 18994 raft_consensus.cc:2454] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 404d864cbcf24ac89deb55459c3a29c2 in term 1.
I20260807 10:43:21.209611 18803 raft_consensus.cc:2454] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 404d864cbcf24ac89deb55459c3a29c2 in term 1.
I20260807 10:43:21.210119 19102 leader_election.cc:302] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 404d864cbcf24ac89deb55459c3a29c2, 5784b7560e644425a1692c5f884f2537; no voters:
I20260807 10:43:21.210446 19301 raft_consensus.cc:2781] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:21.210933 19301 raft_consensus.cc:686] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 1 LEADER]: Becoming Leader. State: Replica: 404d864cbcf24ac89deb55459c3a29c2, State: Running, Role: LEADER
I20260807 10:43:21.211512 19301 consensus_queue.cc:237] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 } } peers { permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 } } peers { permanent_uuid: "404d864cbcf24ac89deb55459c3a29c2" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 36549 } }
I20260807 10:43:21.216696 18581 catalog_manager.cc:5495] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 404d864cbcf24ac89deb55459c3a29c2 (127.11.46.131). New cstate: current_term: 1 leader_uuid: "404d864cbcf24ac89deb55459c3a29c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "404d864cbcf24ac89deb55459c3a29c2" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 36549 } health_report { overall_health: HEALTHY } } }
W20260807 10:43:21.228783 18872 tablet.cc:2369] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:21.238190 19290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.235756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40124 (local address 127.11.46.131:36549)
0807 10:43:21.235989 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.235996 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.236078 (+ 82us) server_negotiation.cc:407] Connection header received
0807 10:43:21.236344 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.236348 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.236486 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.236576 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.237531 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.237535 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.237539 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.237556 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.237595 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.237607 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.237731 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.237842 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.237917 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 10:43:21.238226 19071 tablet.cc:2369] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:21.248275 18994 raft_consensus.cc:1261] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537 [term 1 FOLLOWER]: Refusing update from remote peer 404d864cbcf24ac89deb55459c3a29c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:21.248270 18803 raft_consensus.cc:1261] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a [term 1 FOLLOWER]: Refusing update from remote peer 404d864cbcf24ac89deb55459c3a29c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:21.249404 19301 consensus_queue.cc:1035] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5344792d16e34f338874d0dcabfa823a" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:21.249847 19312 consensus_queue.cc:1035] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5784b7560e644425a1692c5f884f2537" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 35875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 10:43:21.252297 19272 tablet.cc:2369] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:21.278960 18585 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36990:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:21.279357 18585 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36990:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:21.283742 18585 catalog_manager.cc:5782] T 00000000000000000000000000000000 P baf38cc525784dcda077ac5089dfc597: Sending DeleteTablet for 3 replicas of tablet b52d24950c6b48a08717b75f903a2106
I20260807 10:43:21.285300 18775 tablet_service.cc:1514] Processing DeleteTablet for tablet b52d24950c6b48a08717b75f903a2106 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:21 UTC) from {username='slave'} at 127.0.0.1:57844
I20260807 10:43:21.285307 19174 tablet_service.cc:1514] Processing DeleteTablet for tablet b52d24950c6b48a08717b75f903a2106 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:21 UTC) from {username='slave'} at 127.0.0.1:40110
I20260807 10:43:21.285867 18963 tablet_service.cc:1514] Processing DeleteTablet for tablet b52d24950c6b48a08717b75f903a2106 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:21 UTC) from {username='slave'} at 127.0.0.1:42772
I20260807 10:43:21.287540 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 18676
I20260807 10:43:21.295435 19333 tablet_replica.cc:330] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: stopping tablet replica
I20260807 10:43:21.296166 19333 raft_consensus.cc:2229] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:43:21.297197 19333 raft_consensus.cc:2258] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:21.298034 19330 tablet_replica.cc:330] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a: stopping tablet replica
I20260807 10:43:21.298480 19334 tablet_replica.cc:330] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: stopping tablet replica
I20260807 10:43:21.298655 19330 raft_consensus.cc:2229] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:21.298818 19288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.289274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57856 (local address 127.11.46.129:33051)
0807 10:43:21.289510 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.289516 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.294879 (+ 5363us) server_negotiation.cc:407] Connection header received
0807 10:43:21.296004 (+ 1125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.296011 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.296142 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.296228 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.297889 (+ 1661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.297895 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.297900 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.297925 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.297970 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.297989 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.298118 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.298402 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.298478 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:43:21.299145 19334 raft_consensus.cc:2229] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:21.299279 19330 raft_consensus.cc:2258] T b52d24950c6b48a08717b75f903a2106 P 5344792d16e34f338874d0dcabfa823a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:21.300145 18860 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:21.299830 19334 raft_consensus.cc:2258] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:21.302325 19333 ts_tablet_manager.cc:1905] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:21.303681 19334 ts_tablet_manager.cc:1905] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:21.311077 19334 ts_tablet_manager.cc:1918] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:21.311080 19333 ts_tablet_manager.cc:1918] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:21.311379 19334 log.cc:1196] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/b52d24950c6b48a08717b75f903a2106
I20260807 10:43:21.311975 19333 log.cc:1196] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/b52d24950c6b48a08717b75f903a2106
I20260807 10:43:21.312033 19334 ts_tablet_manager.cc:1939] T b52d24950c6b48a08717b75f903a2106 P 5784b7560e644425a1692c5f884f2537: Deleting consensus metadata
I20260807 10:43:21.313016 19333 ts_tablet_manager.cc:1939] T b52d24950c6b48a08717b75f903a2106 P 404d864cbcf24ac89deb55459c3a29c2: Deleting consensus metadata
I20260807 10:43:21.314538 18560 catalog_manager.cc:4841] TS 5784b7560e644425a1692c5f884f2537 (127.11.46.130:35875): tablet b52d24950c6b48a08717b75f903a2106 (table test-table [id=29aca4be37534ade94499847e1d96981]) successfully deleted
I20260807 10:43:21.314873 18556 catalog_manager.cc:4841] TS 404d864cbcf24ac89deb55459c3a29c2 (127.11.46.131:36549): tablet b52d24950c6b48a08717b75f903a2106 (table test-table [id=29aca4be37534ade94499847e1d96981]) successfully deleted
I20260807 10:43:21.457749 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 18676
W20260807 10:43:21.493945 18560 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.46.129:33051 (error 108)
I20260807 10:43:21.494755 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 18876
I20260807 10:43:21.497972 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.497351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33051 (local address 127.0.0.1:57872)
0807 10:43:21.497639 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.497791 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170}
W20260807 10:43:21.498399 18560 catalog_manager.cc:4584] TS 5344792d16e34f338874d0dcabfa823a (127.11.46.129:33051): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b52d24950c6b48a08717b75f903a2106: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33051: connect: Connection refused (error 111)
I20260807 10:43:21.498802 19292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.495963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42782 (local address 127.11.46.130:35875)
0807 10:43:21.496158 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.496165 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.496186 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:43:21.496254 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.496260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.496380 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.496501 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.497676 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.497683 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.497689 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.497711 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.497755 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.497772 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.497902 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.498409 (+ 507us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.498480 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:43:21.499547 19061 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:21.552558 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.551945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33051 (local address 127.0.0.1:57874)
0807 10:43:21.552193 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.552333 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 10:43:21.554042 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.553527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33051 (local address 127.0.0.1:57882)
0807 10:43:21.553750 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.553858 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260807 10:43:21.591741 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 18876
I20260807 10:43:21.614817 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.614252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33051 (local address 127.0.0.1:57886)
0807 10:43:21.614496 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.614615 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 10:43:21.616117 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.615685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33051 (local address 127.0.0.1:57896)
0807 10:43:21.615856 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.615956 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 10:43:21.623907 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 19075
I20260807 10:43:21.631359 19290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.624770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40132 (local address 127.11.46.131:36549)
0807 10:43:21.624960 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:21.624965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:21.624988 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:43:21.625262 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:21.625267 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:21.625324 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:21.625419 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:21.630566 (+ 5147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:21.630571 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:21.630575 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:21.630616 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:21.630666 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:21.630681 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:21.630829 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:21.630936 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 10:43:21.631022 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 10:43:21.632125 19262 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:21.697791 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.697127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33051 (local address 127.0.0.1:57906)
0807 10:43:21.697433 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.697601 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260807 10:43:21.698964 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.698538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33051 (local address 127.0.0.1:57910)
0807 10:43:21.698738 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.698822 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260807 10:43:21.758478 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 19075
I20260807 10:43:21.789045 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 18536
I20260807 10:43:21.790366 18635 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:21.905225 19293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:21.904667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33051 (local address 127.0.0.1:57924)
0807 10:43:21.904916 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:21.905032 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:33051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 10:43:21.905201 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 18536
2026-08-07T10:43:21Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3112 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 10:43:21.963253 11450 mini_oidc.cc:152] Starting JWKS server
I20260807 10:43:21.967224 11450 webserver.cc:460] Webserver started at https://127.0.0.1:39151/ using document root <none> and password file <none>
I20260807 10:43:21.967628 11450 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 10:43:21.968386 11450 webserver.cc:460] Webserver started at http://127.0.0.1:44069/ using document root <none> and password file <none>
2026-08-07T10:43:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:21Z Disabled control of system clock
I20260807 10:43:22.013741 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:43037
--webserver_interface=127.11.46.190
--webserver_port=0
--builtin_ntp_servers=127.11.46.148:34307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:43037
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39151/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/testchainca.cert with env {}
W20260807 10:43:22.389914 19352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:22.390287 19352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:22.390434 19352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:22.398276 19352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:22.398415 19352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:22.398476 19352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:22.398561 19352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:22.398617 19352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 10:43:22.398710 19352 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 10:43:22.398756 19352 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39151/jwks.json
I20260807 10:43:22.410006 19352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:34307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:43037
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:43037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39151/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:22.411516 19352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:22.412999 19352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:22.425341 19360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:22.425382 19363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:22.425740 19358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:22.426820 19352 server_base.cc:1034] running on GCE node
I20260807 10:43:22.427696 19352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:22.429327 19352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:22.430558 19352 hybrid_clock.cc:648] HybridClock initialized: now 1786099402430498 us; error 51 us; skew 500 ppm
I20260807 10:43:22.430950 19352 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:43:22.433662 19352 webserver.cc:460] Webserver started at http://127.11.46.190:41621/ using document root <none> and password file <none>
I20260807 10:43:22.434496 19352 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:22.434605 19352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:22.434914 19352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:22.438305 19352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "fa9dbc69e7b142e58914a9b3c22038c4"
format_stamp: "Formatted at 2026-08-07 10:43:22 on dist-test-slave-42z9"
server_key: "47c019f9d0d5ae510ff97a6203541a90"
server_key_iv: "20fa5f516db3b31cab97b131d69552e9"
server_key_version: "encryptionkey@0"
I20260807 10:43:22.439198 19352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "fa9dbc69e7b142e58914a9b3c22038c4"
format_stamp: "Formatted at 2026-08-07 10:43:22 on dist-test-slave-42z9"
server_key: "47c019f9d0d5ae510ff97a6203541a90"
server_key_iv: "20fa5f516db3b31cab97b131d69552e9"
server_key_version: "encryptionkey@0"
I20260807 10:43:22.445263 19352 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 10:43:22.449668 19371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:22.451376 19352 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:43:22.451606 19352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "fa9dbc69e7b142e58914a9b3c22038c4"
format_stamp: "Formatted at 2026-08-07 10:43:22 on dist-test-slave-42z9"
server_key: "47c019f9d0d5ae510ff97a6203541a90"
server_key_iv: "20fa5f516db3b31cab97b131d69552e9"
server_key_version: "encryptionkey@0"
I20260807 10:43:22.451865 19352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:22.474923 19352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:22.475957 19352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:22.476310 19352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:22.496352 19352 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:43037
I20260807 10:43:22.496378 19445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:43037 every 8 connection(s)
I20260807 10:43:22.497992 19352 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:22.502552 19446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:22.503576 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 19352
I20260807 10:43:22.503841 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:22.504712 11450 external_mini_cluster.cc:1428] Setting key 6dea33d3faff847b25d35048297e30ba
I20260807 10:43:22.518002 19446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4: Bootstrap starting.
I20260807 10:43:22.520550 19452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:22.507003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49346 (local address 127.11.46.190:43037)
0807 10:43:22.508279 (+ 1276us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:22.508304 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:22.508371 (+ 67us) server_negotiation.cc:407] Connection header received
0807 10:43:22.510325 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:22.510369 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:22.511019 (+ 650us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:22.511506 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:22.512250 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:22.513722 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:22.515232 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:22.516065 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:22.516275 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:22.517710 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:22.517720 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:22.517739 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:22.518434 (+ 695us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:22.518554 (+ 120us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:22.518584 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:22.518712 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:22.518993 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 10:43:22.519408 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":752,"thread_start_us":468,"threads_started":1}
I20260807 10:43:22.522253 19446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:22.523813 19446 log.cc:824] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:22.525578 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:43:22.527355 19446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4: No bootstrap required, opened a new log
I20260807 10:43:22.536345 19446 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9dbc69e7b142e58914a9b3c22038c4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 43037 } }
I20260807 10:43:22.536810 19446 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:22.536927 19446 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa9dbc69e7b142e58914a9b3c22038c4, State: Initialized, Role: FOLLOWER
I20260807 10:43:22.537642 19446 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9dbc69e7b142e58914a9b3c22038c4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 43037 } }
I20260807 10:43:22.537899 19446 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:22.538054 19446 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:22.538242 19446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:22.541220 19446 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9dbc69e7b142e58914a9b3c22038c4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 43037 } }
I20260807 10:43:22.541924 19446 leader_election.cc:302] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa9dbc69e7b142e58914a9b3c22038c4; no voters:
I20260807 10:43:22.542575 19446 leader_election.cc:288] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:22.542750 19455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:22.543526 19455 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [term 1 LEADER]: Becoming Leader. State: Replica: fa9dbc69e7b142e58914a9b3c22038c4, State: Running, Role: LEADER
I20260807 10:43:22.544107 19455 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9dbc69e7b142e58914a9b3c22038c4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 43037 } }
I20260807 10:43:22.544855 19446 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:22.547098 19456 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa9dbc69e7b142e58914a9b3c22038c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9dbc69e7b142e58914a9b3c22038c4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 43037 } } }
I20260807 10:43:22.547552 19456 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:22.549158 19457 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa9dbc69e7b142e58914a9b3c22038c4. Latest consensus state: current_term: 1 leader_uuid: "fa9dbc69e7b142e58914a9b3c22038c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa9dbc69e7b142e58914a9b3c22038c4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 43037 } } }
I20260807 10:43:22.549974 19457 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:22.550437 19466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:22.556449 19466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:22.567476 19466 catalog_manager.cc:1347] Generated new cluster ID: b0b6773474f640cea86e37bee9d45c7f
I20260807 10:43:22.567653 19466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:22.590332 19466 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:22.591790 19466 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:22.603236 19466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa9dbc69e7b142e58914a9b3c22038c4: Generated new TSK 0
I20260807 10:43:22.604231 19466 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 10:43:22.655129 19489 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 10:43:22.655336 19489 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 10:43:22.708403 19452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:22.627066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49352 (local address 127.11.46.190:43037)
0807 10:43:22.627302 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:22.627309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:22.627840 (+ 531us) server_negotiation.cc:407] Connection header received
0807 10:43:22.628268 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:22.628273 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:22.628367 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:22.628507 (+ 140us) server_negotiation.cc:226] Negotiated authn=JWT
0807 10:43:22.629202 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:22.630099 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:22.632403 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:22.632916 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:22.633025 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:22.633835 (+ 810us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 10:43:22.707551 (+ 73716us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39151/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 10:43:22.708053 (+ 502us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49352: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39151/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":65}
W20260807 10:43:22.708598 19452 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49352: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39151/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 10:43:22.710052 19488 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:22.626828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:43037 (local address 127.0.0.1:49352)
0807 10:43:22.627694 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:22.627717 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:22.627963 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:22.628569 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:22.628575 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:22.628590 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0807 10:43:22.629013 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:22.629026 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:22.630283 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:22.630290 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:22.632212 (+ 1922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:22.632233 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:22.633132 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:22.633139 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:22.633352 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:22.633501 (+ 149us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 10:43:22.708011 (+ 74510us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39151/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 10:43:22.708341 (+ 330us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.46.190:43037: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39151/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":399,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.46.190:43037: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39151/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 10:43:22.712232 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 19352
I20260807 10:43:22.713616 19439 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:22.820539 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 19352
2026-08-07T10:43:22Z chronyd exiting
I20260807 10:43:22.883565 11450 test_util.cc:175] -----------------------------------------------
I20260807 10:43:22.883736 11450 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786099355061134-11450-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (925 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 10:43:22.888018 11450 mini_oidc.cc:152] Starting JWKS server
I20260807 10:43:22.890080 11450 webserver.cc:460] Webserver started at https://127.0.0.1:36497/ using document root <none> and password file <none>
I20260807 10:43:22.890334 11450 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 10:43:22.891109 11450 webserver.cc:460] Webserver started at http://127.0.0.1:46015/ using document root <none> and password file <none>
2026-08-07T10:43:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:22Z Disabled control of system clock
I20260807 10:43:22.936220 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35415
--webserver_interface=127.11.46.190
--webserver_port=0
--builtin_ntp_servers=127.11.46.148:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:35415
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36497/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/testchainca.cert with env {}
W20260807 10:43:23.308225 19497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:23.308594 19497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:23.308732 19497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:23.317546 19497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:23.317715 19497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:23.317785 19497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:23.317873 19497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:23.317927 19497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 10:43:23.317991 19497 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 10:43:23.318032 19497 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36497/jwks.json
I20260807 10:43:23.332127 19497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:35415
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36497/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:23.333737 19497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:23.335201 19497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:23.347601 19505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:23.347627 19504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:23.347702 19509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:23.348361 19497 server_base.cc:1034] running on GCE node
I20260807 10:43:23.349196 19497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:23.350745 19497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:23.351953 19497 hybrid_clock.cc:648] HybridClock initialized: now 1786099403351908 us; error 34 us; skew 500 ppm
I20260807 10:43:23.352311 19497 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:43:23.354789 19497 webserver.cc:460] Webserver started at http://127.11.46.190:46699/ using document root <none> and password file <none>
I20260807 10:43:23.355507 19497 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:23.355621 19497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:23.355963 19497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:23.359009 19497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "54248112344043dd86ab54ee8d312d95"
format_stamp: "Formatted at 2026-08-07 10:43:23 on dist-test-slave-42z9"
server_key: "f59edf4d7842156e8b3ee3a76a564724"
server_key_iv: "68ecbf7897abd289fdb49f29bde11e2b"
server_key_version: "encryptionkey@0"
I20260807 10:43:23.359833 19497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "54248112344043dd86ab54ee8d312d95"
format_stamp: "Formatted at 2026-08-07 10:43:23 on dist-test-slave-42z9"
server_key: "f59edf4d7842156e8b3ee3a76a564724"
server_key_iv: "68ecbf7897abd289fdb49f29bde11e2b"
server_key_version: "encryptionkey@0"
I20260807 10:43:23.365398 19497 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 10:43:23.369395 19521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:23.371011 19497 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:43:23.371225 19497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "54248112344043dd86ab54ee8d312d95"
format_stamp: "Formatted at 2026-08-07 10:43:23 on dist-test-slave-42z9"
server_key: "f59edf4d7842156e8b3ee3a76a564724"
server_key_iv: "68ecbf7897abd289fdb49f29bde11e2b"
server_key_version: "encryptionkey@0"
I20260807 10:43:23.371470 19497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:23.387642 19497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:23.388614 19497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:23.388938 19497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:23.407876 19497 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:35415
I20260807 10:43:23.407881 19592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:35415 every 8 connection(s)
I20260807 10:43:23.409399 19497 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:23.413360 19593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:23.415354 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 19497
I20260807 10:43:23.415547 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:23.416216 11450 external_mini_cluster.cc:1428] Setting key dfb4f56752683f44a114c98d407c6d0e
I20260807 10:43:23.425666 19593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95: Bootstrap starting.
I20260807 10:43:23.429697 19593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:23.430786 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:23.418364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38328 (local address 127.11.46.190:35415)
0807 10:43:23.419520 (+ 1156us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:23.419541 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:23.419588 (+ 47us) server_negotiation.cc:407] Connection header received
0807 10:43:23.421287 (+ 1699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:23.421313 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:23.421883 (+ 570us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:23.422221 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:23.422830 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:23.424153 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:23.425956 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:23.426689 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:23.426833 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:23.428187 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:23.428195 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:23.428212 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:23.428810 (+ 598us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:23.428918 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:23.428941 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:23.429032 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:23.429281 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 10:43:23.429679 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":457,"threads_started":1}
I20260807 10:43:23.430892 19593 log.cc:824] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:23.434643 19593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95: No bootstrap required, opened a new log
I20260807 10:43:23.435487 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:43:23.443935 19593 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54248112344043dd86ab54ee8d312d95" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35415 } }
I20260807 10:43:23.444352 19593 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:23.444433 19593 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54248112344043dd86ab54ee8d312d95, State: Initialized, Role: FOLLOWER
I20260807 10:43:23.444983 19593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54248112344043dd86ab54ee8d312d95" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35415 } }
I20260807 10:43:23.445209 19593 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:23.445312 19593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:23.445474 19593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:23.447889 19593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54248112344043dd86ab54ee8d312d95" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35415 } }
I20260807 10:43:23.448426 19593 leader_election.cc:302] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54248112344043dd86ab54ee8d312d95; no voters:
I20260807 10:43:23.449009 19593 leader_election.cc:288] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:23.449165 19598 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:23.449975 19598 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [term 1 LEADER]: Becoming Leader. State: Replica: 54248112344043dd86ab54ee8d312d95, State: Running, Role: LEADER
I20260807 10:43:23.450575 19598 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54248112344043dd86ab54ee8d312d95" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35415 } }
I20260807 10:43:23.451290 19593 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:23.453552 19601 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54248112344043dd86ab54ee8d312d95. Latest consensus state: current_term: 1 leader_uuid: "54248112344043dd86ab54ee8d312d95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54248112344043dd86ab54ee8d312d95" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35415 } } }
I20260807 10:43:23.453995 19601 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:23.453864 19600 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54248112344043dd86ab54ee8d312d95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54248112344043dd86ab54ee8d312d95" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35415 } } }
I20260807 10:43:23.454177 19600 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:23.456337 19608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:23.461917 19608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:23.473021 19608 catalog_manager.cc:1347] Generated new cluster ID: 471ffbbde80b42db8d4b3b5feda679cb
I20260807 10:43:23.473311 19608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:23.509773 19608 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:23.511195 19608 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:23.526017 19608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54248112344043dd86ab54ee8d312d95: Generated new TSK 0
I20260807 10:43:23.527066 19608 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 10:43:23.562389 19638 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 10:43:23.562556 19638 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 10:43:23.563724 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:23.542810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38336 (local address 127.11.46.190:35415)
0807 10:43:23.543096 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:23.543102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:23.543527 (+ 425us) server_negotiation.cc:407] Connection header received
0807 10:43:23.543791 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:23.543796 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:23.543881 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:23.544030 (+ 149us) server_negotiation.cc:226] Negotiated authn=JWT
0807 10:43:23.544607 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:23.545373 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:23.547530 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:23.548063 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:23.548164 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:23.548816 (+ 652us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 10:43:23.563107 (+ 14291us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36497/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 10:43:23.563472 (+ 365us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38336: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36497/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":76}
W20260807 10:43:23.563870 19596 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38336: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36497/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 10:43:23.564602 19637 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:23.542677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35415 (local address 127.0.0.1:38336)
0807 10:43:23.543379 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:23.543429 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:23.543606 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:23.544065 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:23.544070 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:23.544084 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0807 10:43:23.544421 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:23.544435 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:23.545553 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:23.545559 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:23.547341 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:23.547361 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:23.548270 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:23.548277 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:23.548481 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:23.548536 (+ 55us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 10:43:23.563413 (+ 14877us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36497/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 10:43:23.563740 (+ 327us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.46.190:35415: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36497/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":369,"threads_started":1}
I20260807 10:43:23.566201 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 19497
I20260807 10:43:23.567531 19587 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:23.668423 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 19497
2026-08-07T10:43:23Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (851 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 10:43:23.739427 11450 mini_oidc.cc:152] Starting JWKS server
I20260807 10:43:23.741564 11450 webserver.cc:460] Webserver started at https://127.0.0.1:42449/ using document root <none> and password file <none>
I20260807 10:43:23.741830 11450 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 10:43:23.742484 11450 webserver.cc:460] Webserver started at http://127.0.0.1:40893/ using document root <none> and password file <none>
2026-08-07T10:43:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:23Z Disabled control of system clock
I20260807 10:43:23.787572 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:40605
--webserver_interface=127.11.46.190
--webserver_port=0
--builtin_ntp_servers=127.11.46.148:40689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:40605
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42449/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 10:43:24.165506 19645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:24.165879 19645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:24.165983 19645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:24.173794 19645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:24.173928 19645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:24.173971 19645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:24.174029 19645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:24.174074 19645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 10:43:24.174139 19645 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 10:43:24.174178 19645 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42449/jwks.json
I20260807 10:43:24.184190 19645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:40689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:40605
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:40605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42449/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:24.185707 19645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:24.187763 19645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:24.200994 19656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:24.201200 19650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:24.201154 19651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:24.202322 19645 server_base.cc:1034] running on GCE node
I20260807 10:43:24.203308 19645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:24.205096 19645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:24.206317 19645 hybrid_clock.cc:648] HybridClock initialized: now 1786099404206250 us; error 69 us; skew 500 ppm
I20260807 10:43:24.206724 19645 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:43:24.209559 19645 webserver.cc:460] Webserver started at http://127.11.46.190:36007/ using document root <none> and password file <none>
I20260807 10:43:24.210451 19645 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:24.210589 19645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:24.210975 19645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:24.214486 19645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "4351d38b1fd3455f9df5b41a7710026f"
format_stamp: "Formatted at 2026-08-07 10:43:24 on dist-test-slave-42z9"
server_key: "4346bab9d84efb22e782775eaaeea9c8"
server_key_iv: "309a5b99031e2dd6df2e7732ab4960be"
server_key_version: "encryptionkey@0"
I20260807 10:43:24.215461 19645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "4351d38b1fd3455f9df5b41a7710026f"
format_stamp: "Formatted at 2026-08-07 10:43:24 on dist-test-slave-42z9"
server_key: "4346bab9d84efb22e782775eaaeea9c8"
server_key_iv: "309a5b99031e2dd6df2e7732ab4960be"
server_key_version: "encryptionkey@0"
I20260807 10:43:24.221896 19645 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:43:24.226061 19667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:24.227725 19645 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:43:24.227946 19645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "4351d38b1fd3455f9df5b41a7710026f"
format_stamp: "Formatted at 2026-08-07 10:43:24 on dist-test-slave-42z9"
server_key: "4346bab9d84efb22e782775eaaeea9c8"
server_key_iv: "309a5b99031e2dd6df2e7732ab4960be"
server_key_version: "encryptionkey@0"
I20260807 10:43:24.228206 19645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:24.246202 19645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:24.247224 19645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:24.247572 19645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:24.267819 19645 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:40605
I20260807 10:43:24.267840 19743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:40605 every 8 connection(s)
I20260807 10:43:24.269430 19645 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:24.274024 19744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:24.279102 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 19645
I20260807 10:43:24.279368 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:24.280211 11450 external_mini_cluster.cc:1428] Setting key 696c9093f264d108cda85d7480c483e2
I20260807 10:43:24.287604 19744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f: Bootstrap starting.
I20260807 10:43:24.291267 19744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:24.292897 19744 log.cc:824] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:24.295855 19751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:24.282480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47766 (local address 127.11.46.190:40605)
0807 10:43:24.283646 (+ 1166us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:24.283658 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:24.283712 (+ 54us) server_negotiation.cc:407] Connection header received
0807 10:43:24.285945 (+ 2233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:24.285979 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:24.286590 (+ 611us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:24.287030 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:24.287706 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:24.289126 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:24.290622 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:24.291419 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:24.291607 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:24.292995 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:24.293004 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:24.293021 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:24.293842 (+ 821us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:24.293973 (+ 131us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:24.294013 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:24.294178 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:24.294411 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 10:43:24.294783 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":440,"threads_started":1}
I20260807 10:43:24.296607 19744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f: No bootstrap required, opened a new log
I20260807 10:43:24.300504 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:43:24.305351 19744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4351d38b1fd3455f9df5b41a7710026f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40605 } }
I20260807 10:43:24.305840 19744 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:24.305948 19744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4351d38b1fd3455f9df5b41a7710026f, State: Initialized, Role: FOLLOWER
I20260807 10:43:24.306566 19744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4351d38b1fd3455f9df5b41a7710026f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40605 } }
I20260807 10:43:24.306834 19744 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:24.306979 19744 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:24.307183 19744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:24.310050 19744 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4351d38b1fd3455f9df5b41a7710026f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40605 } }
I20260807 10:43:24.310709 19744 leader_election.cc:302] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4351d38b1fd3455f9df5b41a7710026f; no voters:
I20260807 10:43:24.311388 19744 leader_election.cc:288] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:24.311551 19754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:24.312358 19754 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [term 1 LEADER]: Becoming Leader. State: Replica: 4351d38b1fd3455f9df5b41a7710026f, State: Running, Role: LEADER
I20260807 10:43:24.312986 19754 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4351d38b1fd3455f9df5b41a7710026f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40605 } }
I20260807 10:43:24.313875 19744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:24.316354 19758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4351d38b1fd3455f9df5b41a7710026f. Latest consensus state: current_term: 1 leader_uuid: "4351d38b1fd3455f9df5b41a7710026f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4351d38b1fd3455f9df5b41a7710026f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40605 } } }
I20260807 10:43:24.316350 19757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4351d38b1fd3455f9df5b41a7710026f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4351d38b1fd3455f9df5b41a7710026f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40605 } } }
I20260807 10:43:24.316826 19758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:24.316826 19757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:24.320806 19766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:24.326407 19766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:24.337739 19766 catalog_manager.cc:1347] Generated new cluster ID: a1b6100e26ff49a197442d3e5ce2bea5
I20260807 10:43:24.337888 19766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:24.367646 19766 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:24.369092 19766 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:24.378940 19766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4351d38b1fd3455f9df5b41a7710026f: Generated new TSK 0
I20260807 10:43:24.379945 19766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:43:24.412966 19751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:24.404138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47778 (local address 127.11.46.190:40605)
0807 10:43:24.404389 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:24.404396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:24.404797 (+ 401us) server_negotiation.cc:407] Connection header received
0807 10:43:24.405038 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:24.405044 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:24.405126 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:24.405271 (+ 145us) server_negotiation.cc:226] Negotiated authn=JWT
0807 10:43:24.405896 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:24.406692 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:24.408804 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:24.409329 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:24.409463 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:24.410142 (+ 679us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 10:43:24.412211 (+ 2069us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42449/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 10:43:24.412577 (+ 366us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47778: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42449/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":76}
W20260807 10:43:24.413136 19790 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:24.404005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40605 (local address 127.0.0.1:47778)
0807 10:43:24.404648 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:24.404668 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:24.404839 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:24.405302 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:24.405307 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:24.405321 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0807 10:43:24.405732 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:24.405745 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:24.406845 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:24.406851 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:24.408611 (+ 1760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:24.408629 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:24.409586 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:24.409594 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:24.409813 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:24.409868 (+ 55us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 10:43:24.412445 (+ 2577us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42449/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 10:43:24.412713 (+ 268us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.46.190:40605: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42449/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":323,"threads_started":1}
W20260807 10:43:24.413130 19751 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47778: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42449/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
I20260807 10:43:24.414883 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 19645
I20260807 10:43:24.416292 19736 generic_service.cc:196] Checking for leaks (request via RPC)
E20260807 10:43:24.429841 19791 webserver.cc:533] Webserver: sslize failed:
E20260807 10:43:24.430012 19791 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 10:43:24.520772 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 19645
2026-08-07T10:43:24Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (849 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T10:43:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:24Z Disabled control of system clock
I20260807 10:43:24.631650 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:37029
--webserver_interface=127.11.46.190
--webserver_port=0
--builtin_ntp_servers=127.11.46.148:35421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:37029
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/testchainca.cert with env {}
W20260807 10:43:25.005194 19797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:25.005614 19797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:25.005759 19797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:25.014756 19797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:25.014916 19797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:25.014956 19797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:25.015017 19797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:25.015062 19797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 10:43:25.015127 19797 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 10:43:25.015167 19797 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 10:43:25.026075 19797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:37029
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:37029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:25.027551 19797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:25.028985 19797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:25.042017 19805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:25.042017 19813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:25.042196 19804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:25.043108 19797 server_base.cc:1034] running on GCE node
I20260807 10:43:25.044077 19797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:25.045796 19797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:25.047012 19797 hybrid_clock.cc:648] HybridClock initialized: now 1786099405046951 us; error 67 us; skew 500 ppm
I20260807 10:43:25.047400 19797 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:43:25.050041 19797 webserver.cc:460] Webserver started at http://127.11.46.190:35959/ using document root <none> and password file <none>
I20260807 10:43:25.050872 19797 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:25.051007 19797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:25.051350 19797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:25.054771 19797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "bd809881a1c349a3b8794f0cb3dd1660"
format_stamp: "Formatted at 2026-08-07 10:43:25 on dist-test-slave-42z9"
server_key: "e33f3ded9957218ba9072960a67d4cf5"
server_key_iv: "2a327b8b1542eb92d5ec3e01db66b918"
server_key_version: "encryptionkey@0"
I20260807 10:43:25.055774 19797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "bd809881a1c349a3b8794f0cb3dd1660"
format_stamp: "Formatted at 2026-08-07 10:43:25 on dist-test-slave-42z9"
server_key: "e33f3ded9957218ba9072960a67d4cf5"
server_key_iv: "2a327b8b1542eb92d5ec3e01db66b918"
server_key_version: "encryptionkey@0"
I20260807 10:43:25.062256 19797 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:43:25.066542 19821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:25.068216 19797 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260807 10:43:25.068430 19797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "bd809881a1c349a3b8794f0cb3dd1660"
format_stamp: "Formatted at 2026-08-07 10:43:25 on dist-test-slave-42z9"
server_key: "e33f3ded9957218ba9072960a67d4cf5"
server_key_iv: "2a327b8b1542eb92d5ec3e01db66b918"
server_key_version: "encryptionkey@0"
I20260807 10:43:25.068668 19797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:25.081079 19797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:25.082036 19797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:25.082336 19797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:25.100673 19797 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:37029
I20260807 10:43:25.100695 19896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:37029 every 8 connection(s)
I20260807 10:43:25.102216 19797 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:25.106436 19898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:25.112671 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 19797
I20260807 10:43:25.112856 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:25.113566 11450 external_mini_cluster.cc:1428] Setting key c91517c7b37d0ba1832d034a8c5766df
I20260807 10:43:25.119015 19898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660: Bootstrap starting.
I20260807 10:43:25.122658 19898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:25.123832 19898 log.cc:824] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:25.127197 19898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660: No bootstrap required, opened a new log
I20260807 10:43:25.128156 19902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:25.115801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53936 (local address 127.11.46.190:37029)
0807 10:43:25.117017 (+ 1216us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:25.117029 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:25.117081 (+ 52us) server_negotiation.cc:407] Connection header received
0807 10:43:25.118887 (+ 1806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:25.118916 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:25.119496 (+ 580us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:25.119923 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:25.120544 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:25.122011 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:25.123447 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:25.124228 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:25.124438 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:25.125674 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:25.125682 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:25.125701 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:43:25.126284 (+ 583us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:25.126371 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:43:25.126397 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:25.126514 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:25.126763 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 10:43:25.127107 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":411,"threads_started":1}
I20260807 10:43:25.132382 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:43:25.135829 19898 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd809881a1c349a3b8794f0cb3dd1660" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37029 } }
I20260807 10:43:25.136358 19898 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:25.136476 19898 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd809881a1c349a3b8794f0cb3dd1660, State: Initialized, Role: FOLLOWER
I20260807 10:43:25.137127 19898 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd809881a1c349a3b8794f0cb3dd1660" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37029 } }
I20260807 10:43:25.137399 19898 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:25.137609 19898 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:25.137852 19898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:25.140398 19898 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd809881a1c349a3b8794f0cb3dd1660" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37029 } }
I20260807 10:43:25.141018 19898 leader_election.cc:302] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd809881a1c349a3b8794f0cb3dd1660; no voters:
I20260807 10:43:25.141701 19898 leader_election.cc:288] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:25.141840 19905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:25.142550 19905 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [term 1 LEADER]: Becoming Leader. State: Replica: bd809881a1c349a3b8794f0cb3dd1660, State: Running, Role: LEADER
I20260807 10:43:25.143133 19905 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd809881a1c349a3b8794f0cb3dd1660" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37029 } }
I20260807 10:43:25.143867 19898 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:25.146078 19906 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd809881a1c349a3b8794f0cb3dd1660" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd809881a1c349a3b8794f0cb3dd1660" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37029 } } }
I20260807 10:43:25.146114 19907 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd809881a1c349a3b8794f0cb3dd1660. Latest consensus state: current_term: 1 leader_uuid: "bd809881a1c349a3b8794f0cb3dd1660" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd809881a1c349a3b8794f0cb3dd1660" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37029 } } }
I20260807 10:43:25.146539 19906 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:25.146548 19907 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:25.149591 19918 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:25.155858 19918 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:25.167483 19918 catalog_manager.cc:1347] Generated new cluster ID: 0404502eecf94b4f89c82505b3eb8e06
I20260807 10:43:25.167620 19918 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:25.178916 19918 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:25.181041 19918 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:25.199044 19918 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd809881a1c349a3b8794f0cb3dd1660: Generated new TSK 0
I20260807 10:43:25.200404 19918 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:43:25.285961 19902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:25.218321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53938 (local address 127.11.46.190:37029)
0807 10:43:25.218561 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:25.218568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:25.218996 (+ 428us) server_negotiation.cc:407] Connection header received
0807 10:43:25.219256 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:25.219262 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:25.219408 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:25.219602 (+ 194us) server_negotiation.cc:226] Negotiated authn=JWT
0807 10:43:25.220088 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:25.221255 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:25.222947 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:25.223804 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:25.223967 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:25.224533 (+ 566us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 10:43:25.285046 (+ 60513us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 10:43:25.285584 (+ 538us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53938: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":86}
W20260807 10:43:25.286063 19944 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:25.218112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:37029 (local address 127.0.0.1:53938)
0807 10:43:25.218870 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:25.218896 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:25.219059 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:25.219626 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:25.219629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:25.219639 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0807 10:43:25.219923 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:25.219931 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:25.221533 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:25.221538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:25.222731 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:25.222745 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:25.224004 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:25.224009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:25.224159 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:25.224204 (+ 45us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 10:43:25.285431 (+ 61227us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 10:43:25.285743 (+ 312us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.46.190:37029: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":444,"threads_started":1}
W20260807 10:43:25.286123 19902 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53938: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260807 10:43:25.287988 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 19797
I20260807 10:43:25.289213 19890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:25.394661 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 19797
2026-08-07T10:43:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (854 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (481 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (479 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:43:26 dist-test-slave-42z9 krb5kdc[19965](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:43:26 dist-test-slave-42z9 krb5kdc[19965](info): set up 2 sockets
Aug 07 10:43:26 dist-test-slave-42z9 krb5kdc[19965](info): commencing operation
krb5kdc: starting...
W20260807 10:43:27.578851 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:43:27 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:43:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:43:27.883188 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36997
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:34869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:36997
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:28.260878 19981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:28.261264 19981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:28.261387 19981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:28.269299 19981 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:28.269469 19981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:28.269559 19981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:28.269636 19981 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:28.269683 19981 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:28.280536 19981 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:34869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:36997
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:28.282135 19981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:28.283531 19981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:28.296329 19986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:28.296283 19994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:28.296247 19987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:28.297211 19981 server_base.cc:1034] running on GCE node
I20260807 10:43:28.298139 19981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:28.299775 19981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:28.301016 19981 hybrid_clock.cc:648] HybridClock initialized: now 1786099408300957 us; error 46 us; skew 500 ppm
I20260807 10:43:28.301410 19981 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:28 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099408, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:28.308439 19981 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:43:28.310365 19981 webserver.cc:460] Webserver started at http://127.11.46.190:39013/ using document root <none> and password file <none>
I20260807 10:43:28.311235 19981 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:28.311378 19981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:28.311733 19981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:28.315387 19981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "6afbe04c26524304ab84946af6912516"
format_stamp: "Formatted at 2026-08-07 10:43:28 on dist-test-slave-42z9"
server_key: "d047cb68ba38de8467341a22d6d889cd"
server_key_iv: "a23e5e564ae8f56d9a766dac581b07ef"
server_key_version: "encryptionkey@0"
I20260807 10:43:28.316350 19981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "6afbe04c26524304ab84946af6912516"
format_stamp: "Formatted at 2026-08-07 10:43:28 on dist-test-slave-42z9"
server_key: "d047cb68ba38de8467341a22d6d889cd"
server_key_iv: "a23e5e564ae8f56d9a766dac581b07ef"
server_key_version: "encryptionkey@0"
I20260807 10:43:28.322717 19981 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:43:28.326946 20003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:28.328507 19981 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:43:28.328729 19981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "6afbe04c26524304ab84946af6912516"
format_stamp: "Formatted at 2026-08-07 10:43:28 on dist-test-slave-42z9"
server_key: "d047cb68ba38de8467341a22d6d889cd"
server_key_iv: "a23e5e564ae8f56d9a766dac581b07ef"
server_key_version: "encryptionkey@0"
I20260807 10:43:28.328971 19981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:28.354512 19981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:28.358999 19981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:28.359315 19981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:28.379355 19981 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:36997
I20260807 10:43:28.379385 20068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:36997 every 8 connection(s)
I20260807 10:43:28.380899 19981 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:28.384394 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 19981
I20260807 10:43:28.384639 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:28.385293 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:28.385414 11450 external_mini_cluster.cc:1428] Setting key fa6de1429012f4ae4d1e3008fcf2a3e7
I20260807 10:43:28.401338 20070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516: Bootstrap starting.
Aug 07 10:43:28 dist-test-slave-42z9 krb5kdc[19965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:28.405742 20070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:28.407198 20070 log.cc:824] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:28.410923 20070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516: No bootstrap required, opened a new log
I20260807 10:43:28.411661 20075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:28.387535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58608 (local address 127.11.46.190:36997)
0807 10:43:28.388373 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:28.388386 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:28.388435 (+ 49us) server_negotiation.cc:407] Connection header received
0807 10:43:28.390432 (+ 1997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:28.390462 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:28.390961 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:28.391379 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:28.393496 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:28.395059 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:28.396908 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:28.397761 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:28.397924 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:28.402781 (+ 4857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:28.402794 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:28.402815 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:28.402883 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:28.406819 (+ 3936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:28.407643 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:28.407653 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:28.407661 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:28.407919 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:28.408384 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:28.408388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:28.408390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:28.409086 (+ 696us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:28.409386 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:28.409835 (+ 449us) server_negotiation.cc:299] Negotiation successful
0807 10:43:28.410299 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":362,"threads_started":1}
I20260807 10:43:28.419418 20070 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afbe04c26524304ab84946af6912516" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36997 } }
I20260807 10:43:28.419821 20070 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:28.419901 20070 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afbe04c26524304ab84946af6912516, State: Initialized, Role: FOLLOWER
I20260807 10:43:28.420418 20070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afbe04c26524304ab84946af6912516" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36997 } }
I20260807 10:43:28.420637 20070 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:28.420740 20070 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:28.420876 20070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:28.423380 20070 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afbe04c26524304ab84946af6912516" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36997 } }
I20260807 10:43:28.423913 20070 leader_election.cc:302] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6afbe04c26524304ab84946af6912516; no voters:
I20260807 10:43:28.424481 20070 leader_election.cc:288] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:28.424618 20077 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:28.425310 20077 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [term 1 LEADER]: Becoming Leader. State: Replica: 6afbe04c26524304ab84946af6912516, State: Running, Role: LEADER
I20260807 10:43:28.425937 20077 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afbe04c26524304ab84946af6912516" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36997 } }
I20260807 10:43:28.426677 20070 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:28.428586 20078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6afbe04c26524304ab84946af6912516" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afbe04c26524304ab84946af6912516" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36997 } } }
I20260807 10:43:28.428987 20078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:28.429561 20080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6afbe04c26524304ab84946af6912516. Latest consensus state: current_term: 1 leader_uuid: "6afbe04c26524304ab84946af6912516" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6afbe04c26524304ab84946af6912516" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36997 } } }
I20260807 10:43:28.429890 20080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:28.430706 20083 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:28.436686 20083 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:28.448172 20083 catalog_manager.cc:1347] Generated new cluster ID: 396513761efd4f4390b7ad9378e14526
I20260807 10:43:28.448321 20083 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:28.471158 20083 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:28.472771 20083 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:28.480726 20083 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6afbe04c26524304ab84946af6912516: Generated new TSK 0
I20260807 10:43:28.481771 20083 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:43:28.554641 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36997
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:34869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:28.937577 20112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:28.937944 20112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:28.938097 20112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:28.946247 20112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:28.946411 20112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:28.946581 20112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:28.960826 20112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:34869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:28.962535 20112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:28.964720 20112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:28.983315 20118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:28.983282 20119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:28.984334 20121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:28.984828 20112 server_base.cc:1034] running on GCE node
I20260807 10:43:28.985699 20112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:28.987021 20112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:28.988255 20112 hybrid_clock.cc:648] HybridClock initialized: now 1786099408988172 us; error 84 us; skew 500 ppm
I20260807 10:43:28.988660 20112 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:28 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099408, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:28.992513 20112 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:43:28.994773 20112 webserver.cc:460] Webserver started at http://127.11.46.129:45133/ using document root <none> and password file <none>
I20260807 10:43:28.995776 20112 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:28.995946 20112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:28.996358 20112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:29.000994 20112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "14595ffab5314f20bd0107fe3aaa866b"
format_stamp: "Formatted at 2026-08-07 10:43:28 on dist-test-slave-42z9"
server_key: "07e4777b7616b840f1a786c918e26fe5"
server_key_iv: "3332ce1ca50396475bf21621b584a48b"
server_key_version: "encryptionkey@0"
I20260807 10:43:29.002096 20112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "14595ffab5314f20bd0107fe3aaa866b"
format_stamp: "Formatted at 2026-08-07 10:43:28 on dist-test-slave-42z9"
server_key: "07e4777b7616b840f1a786c918e26fe5"
server_key_iv: "3332ce1ca50396475bf21621b584a48b"
server_key_version: "encryptionkey@0"
I20260807 10:43:29.008189 20112 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:43:29.012274 20131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:29.013875 20112 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 10:43:29.014078 20112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "14595ffab5314f20bd0107fe3aaa866b"
format_stamp: "Formatted at 2026-08-07 10:43:28 on dist-test-slave-42z9"
server_key: "07e4777b7616b840f1a786c918e26fe5"
server_key_iv: "3332ce1ca50396475bf21621b584a48b"
server_key_version: "encryptionkey@0"
I20260807 10:43:29.014312 20112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:29.039464 20112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:29.044147 20112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:29.044453 20112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:29.045553 20112 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:29.047051 20112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:29.047138 20112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:29.047273 20112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:29.047333 20112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:29.084118 20112 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:38715
I20260807 10:43:29.084182 20288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:38715 every 8 connection(s)
I20260807 10:43:29.085780 20112 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:29.096094 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 20112
I20260807 10:43:29.096312 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:43:29.096992 11450 external_mini_cluster.cc:1428] Setting key 2dce5d515c3c926adb8dace332c845cf
Aug 07 10:43:29 dist-test-slave-42z9 krb5kdc[19965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099408, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:29.110787 20292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:29.088882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:52847 (local address 127.11.46.190:36997)
0807 10:43:29.089468 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:29.089476 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:29.090699 (+ 1223us) server_negotiation.cc:407] Connection header received
0807 10:43:29.092752 (+ 2053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:29.092757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:29.092842 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:29.092949 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:29.094892 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:29.095729 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:29.097830 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:29.098326 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:29.098454 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:29.103227 (+ 4773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:29.103236 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:29.103240 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:29.103295 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:29.106603 (+ 3308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:29.107788 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:29.107795 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:29.107798 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:29.107989 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:29.108536 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:29.108541 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:29.108544 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:29.108934 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:29.109111 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:29.110121 (+ 1010us) server_negotiation.cc:299] Negotiation successful
0807 10:43:29.110405 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":266,"threads_started":1}
I20260807 10:43:29.111935 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:29.089601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36997 (local address 127.11.46.129:52847)
0807 10:43:29.090462 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:29.090511 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:29.092403 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:29.093195 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:29.093205 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:29.093931 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:29.094638 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:29.094663 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:29.095973 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:29.095978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:29.097599 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:29.097621 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:29.098650 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:29.098659 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:29.099023 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:29.099981 (+ 958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:29.100010 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:29.102844 (+ 2834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:29.106851 (+ 4007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:29.106864 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:29.106889 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:29.107599 (+ 710us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:29.108113 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:29.108117 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:29.108120 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:29.108395 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:29.109069 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:29.109083 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:29.109630 (+ 547us) client_negotiation.cc:769] Sending connection context
0807 10:43:29.109953 (+ 323us) client_negotiation.cc:240] Negotiation successful
0807 10:43:29.110560 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":333,"threads_started":1}
I20260807 10:43:29.113844 20289 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36997
I20260807 10:43:29.114219 20289 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:29.115072 20289 heartbeater.cc:511] Master 127.11.46.190:36997 requested a full tablet report, sending...
I20260807 10:43:29.117789 20024 ts_manager.cc:194] Registered new tserver with Master: 14595ffab5314f20bd0107fe3aaa866b (127.11.46.129:38715)
I20260807 10:43:29.119607 20024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:52847
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:43:29.163125 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36997
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:34869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:29.555837 20296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:29.556200 20296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:29.556332 20296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:29.564345 20296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:29.564517 20296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:29.564680 20296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:29.575378 20296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:34869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:29.576901 20296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:29.578522 20296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:29.593945 20304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:29.593981 20310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:29.593885 20306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:29.595145 20296 server_base.cc:1034] running on GCE node
I20260807 10:43:29.595870 20296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:29.597030 20296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:29.598270 20296 hybrid_clock.cc:648] HybridClock initialized: now 1786099409598211 us; error 47 us; skew 500 ppm
I20260807 10:43:29.598637 20296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:29 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:29.602201 20296 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:43:29.604063 20296 webserver.cc:460] Webserver started at http://127.11.46.130:37601/ using document root <none> and password file <none>
I20260807 10:43:29.604931 20296 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:29.605093 20296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:29.605501 20296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:29.609212 20296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "31697dc3c6144dd797f3406135b0efcc"
format_stamp: "Formatted at 2026-08-07 10:43:29 on dist-test-slave-42z9"
server_key: "f59e98e79bd773255edd1491f8148a4c"
server_key_iv: "6c8794fdeb34de67fc7f9daeca2214c1"
server_key_version: "encryptionkey@0"
I20260807 10:43:29.610217 20296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "31697dc3c6144dd797f3406135b0efcc"
format_stamp: "Formatted at 2026-08-07 10:43:29 on dist-test-slave-42z9"
server_key: "f59e98e79bd773255edd1491f8148a4c"
server_key_iv: "6c8794fdeb34de67fc7f9daeca2214c1"
server_key_version: "encryptionkey@0"
I20260807 10:43:29.616369 20296 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:43:29.621105 20323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:29.622819 20296 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:29.623035 20296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "31697dc3c6144dd797f3406135b0efcc"
format_stamp: "Formatted at 2026-08-07 10:43:29 on dist-test-slave-42z9"
server_key: "f59e98e79bd773255edd1491f8148a4c"
server_key_iv: "6c8794fdeb34de67fc7f9daeca2214c1"
server_key_version: "encryptionkey@0"
I20260807 10:43:29.623274 20296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:29.638264 20296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:29.643383 20296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:29.643713 20296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:29.644853 20296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:29.646528 20296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:29.646626 20296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:29.646766 20296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:29.646826 20296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:29.680910 20296 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:33125
I20260807 10:43:29.680956 20477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:33125 every 8 connection(s)
I20260807 10:43:29.682368 20296 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:29.684466 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 20296
I20260807 10:43:29.684659 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:43:29.685261 11450 external_mini_cluster.cc:1428] Setting key dfb4b2cdb1fd590f74f73ebbd23ea066
Aug 07 10:43:29 dist-test-slave-42z9 krb5kdc[19965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:29.706390 20481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:29.685291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:50649 (local address 127.11.46.190:36997)
0807 10:43:29.685814 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:29.685819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:29.687362 (+ 1543us) server_negotiation.cc:407] Connection header received
0807 10:43:29.689736 (+ 2374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:29.689741 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:29.689812 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:29.689896 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:29.691979 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:29.692713 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:29.694873 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:29.695341 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:29.695440 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:29.699884 (+ 4444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:29.699890 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:29.699893 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:29.699932 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:29.702926 (+ 2994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:29.703773 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:29.703778 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:29.703780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:29.703922 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:29.704401 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:29.704405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:29.704407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:29.704732 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:29.704883 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:29.705720 (+ 837us) server_negotiation.cc:299] Negotiation successful
0807 10:43:29.705990 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":281,"threads_started":1}
I20260807 10:43:29.707530 20482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:29.686048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36997 (local address 127.11.46.130:50649)
0807 10:43:29.686996 (+ 948us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:29.687077 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:29.689371 (+ 2294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:29.690203 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:29.690216 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:29.690967 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:29.691795 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:29.691822 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:29.692879 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:29.692885 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:29.694726 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:29.694743 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:29.695587 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:29.695595 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:29.695892 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:29.696671 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:29.696704 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:29.699592 (+ 2888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:29.703108 (+ 3516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:29.703116 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:29.703131 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:29.703621 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:29.704037 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:29.704041 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:29.704043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:29.704266 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:29.704870 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:29.704878 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:29.705281 (+ 403us) client_negotiation.cc:769] Sending connection context
0807 10:43:29.705595 (+ 314us) client_negotiation.cc:240] Negotiation successful
0807 10:43:29.706220 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":393,"threads_started":1}
I20260807 10:43:29.709215 20479 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36997
I20260807 10:43:29.709609 20479 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:29.710444 20479 heartbeater.cc:511] Master 127.11.46.190:36997 requested a full tablet report, sending...
I20260807 10:43:29.712317 20024 ts_manager.cc:194] Registered new tserver with Master: 31697dc3c6144dd797f3406135b0efcc (127.11.46.130:33125)
I20260807 10:43:29.713613 20024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:50649
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:43:29.750830 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36997
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:34869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:43:30.123346 20289 heartbeater.cc:503] Master 127.11.46.190:36997 was elected leader, sending a full tablet report...
W20260807 10:43:30.126120 20486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:30.126439 20486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:30.126596 20486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:30.134609 20486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:30.134756 20486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:30.134914 20486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:30.145643 20486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:34869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:30.147193 20486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:30.148710 20486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:30.164013 20493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:30.163986 20497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:30.164084 20492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:30.164958 20486 server_base.cc:1034] running on GCE node
I20260807 10:43:30.165731 20486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:30.166851 20486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:30.168076 20486 hybrid_clock.cc:648] HybridClock initialized: now 1786099410168018 us; error 47 us; skew 500 ppm
I20260807 10:43:30.168481 20486 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:30.172073 20486 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:43:30.173847 20486 webserver.cc:460] Webserver started at http://127.11.46.131:46257/ using document root <none> and password file <none>
I20260807 10:43:30.174638 20486 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:30.174777 20486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:30.175117 20486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:30.178469 20486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "8d47811191d340558311482fbfe1f3c2"
format_stamp: "Formatted at 2026-08-07 10:43:30 on dist-test-slave-42z9"
server_key: "a250406b9f001455ece59b9ced367c28"
server_key_iv: "7608b6718d416b3c182a8573751a1483"
server_key_version: "encryptionkey@0"
I20260807 10:43:30.179364 20486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "8d47811191d340558311482fbfe1f3c2"
format_stamp: "Formatted at 2026-08-07 10:43:30 on dist-test-slave-42z9"
server_key: "a250406b9f001455ece59b9ced367c28"
server_key_iv: "7608b6718d416b3c182a8573751a1483"
server_key_version: "encryptionkey@0"
I20260807 10:43:30.185153 20486 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 10:43:30.189172 20507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:30.190783 20486 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:43:30.190985 20486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "8d47811191d340558311482fbfe1f3c2"
format_stamp: "Formatted at 2026-08-07 10:43:30 on dist-test-slave-42z9"
server_key: "a250406b9f001455ece59b9ced367c28"
server_key_iv: "7608b6718d416b3c182a8573751a1483"
server_key_version: "encryptionkey@0"
I20260807 10:43:30.191221 20486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:30.216085 20486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:30.221105 20486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:30.221400 20486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:30.222630 20486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:30.224188 20486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:30.224283 20486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:30.224391 20486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:30.224439 20486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:30.258262 20486 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:35659
I20260807 10:43:30.258314 20672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:35659 every 8 connection(s)
I20260807 10:43:30.259721 20486 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:30.263255 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 20486
I20260807 10:43:30.263450 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:43:30.264060 11450 external_mini_cluster.cc:1428] Setting key 887a6a41b52a3e7fc6cfb1b6c71c5602
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:30.282161 20677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:30.262530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:37757 (local address 127.11.46.190:36997)
0807 10:43:30.263045 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:30.263050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:30.264299 (+ 1249us) server_negotiation.cc:407] Connection header received
0807 10:43:30.266615 (+ 2316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:30.266620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:30.266719 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:30.266819 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:30.268715 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.269632 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.271336 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.271764 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.271890 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:30.275805 (+ 3915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:30.275810 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:30.275813 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:30.275862 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:30.278461 (+ 2599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.279583 (+ 1122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.279590 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.279593 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.279773 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.280373 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.280378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.280381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.280738 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:30.280872 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:30.281634 (+ 762us) server_negotiation.cc:299] Negotiation successful
0807 10:43:30.281853 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":286,"threads_started":1}
I20260807 10:43:30.283265 20678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:30.263185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36997 (local address 127.11.46.131:37757)
0807 10:43:30.264096 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:30.264161 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:30.266287 (+ 2126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:30.267125 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:30.267135 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:30.267826 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:30.268506 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:30.268533 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.269807 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.269811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:30.271159 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:30.271177 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.272052 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.272060 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:30.272319 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:30.273034 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:30.273060 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:30.275523 (+ 2463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:30.278714 (+ 3191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:30.278725 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:30.278754 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:30.279432 (+ 678us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:30.279896 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:30.279902 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:30.279905 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:30.280240 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:30.280854 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:30.280860 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:30.281258 (+ 398us) client_negotiation.cc:769] Sending connection context
0807 10:43:30.281565 (+ 307us) client_negotiation.cc:240] Negotiation successful
0807 10:43:30.282051 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":370,"threads_started":1}
I20260807 10:43:30.284804 20673 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36997
I20260807 10:43:30.285151 20673 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:30.286010 20673 heartbeater.cc:511] Master 127.11.46.190:36997 requested a full tablet report, sending...
I20260807 10:43:30.287714 20024 ts_manager.cc:194] Registered new tserver with Master: 8d47811191d340558311482fbfe1f3c2 (127.11.46.131:35659)
I20260807 10:43:30.288666 20024 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:37757
I20260807 10:43:30.293002 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/test-admin.keytab.
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:30.327106 11450 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 10:43:30.333103 20684 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:30.330218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53890 (local address 127.11.46.129:38715)
0807 10:43:30.330926 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:30.330934 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:30.330962 (+ 28us) server_negotiation.cc:407] Connection header received
0807 10:43:30.331037 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:30.331044 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:30.331259 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:30.331438 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:30.332650 (+ 1212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53890: BlockingRecv error: recv got EOF from 127.0.0.1:53890 (error 108)
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":374,"threads_started":1}
W20260807 10:43:30.333271 11450 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5cc' of type FILE
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:30.335049 11450 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:30.336447 11450 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:43:30.352991 20684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:30.338365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53896 (local address 127.11.46.129:38715)
0807 10:43:30.338558 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:30.338565 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:30.338715 (+ 150us) server_negotiation.cc:407] Connection header received
0807 10:43:30.338881 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:30.338886 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:30.338960 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:30.339050 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:30.340168 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.341196 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.342601 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.343237 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.343357 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:30.347289 (+ 3932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:30.347308 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:30.347328 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:30.347383 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:30.350240 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.351011 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.351019 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.351022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.351164 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.351455 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.351458 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.351460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.351870 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:30.352119 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:30.352364 (+ 245us) server_negotiation.cc:299] Negotiation successful
0807 10:43:30.352616 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 10:43:30.359162 20684 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:30.357393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53912 (local address 127.11.46.129:38715)
0807 10:43:30.357654 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:30.357659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:30.357895 (+ 236us) server_negotiation.cc:407] Connection header received
0807 10:43:30.358051 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:30.358055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:30.358118 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:30.358200 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:30.358908 (+ 708us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53912: BlockingRecv error: recv got EOF from 127.0.0.1:53912 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
W20260807 10:43:30.359378 11450 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5cc' of type FILE
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:30.360908 11450 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:30.362325 11450 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:43:30.377324 20684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:30.363777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53926 (local address 127.11.46.129:38715)
0807 10:43:30.363946 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:30.363950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:30.364285 (+ 335us) server_negotiation.cc:407] Connection header received
0807 10:43:30.364495 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:30.364500 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:30.364571 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:30.364666 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:30.365693 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.366538 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.367752 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.368195 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.368295 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:30.372180 (+ 3885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:30.372186 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:30.372190 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:30.372250 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:30.374856 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.375616 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.375621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.375623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.375763 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.376080 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.376083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.376085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.376378 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:30.376601 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:30.376817 (+ 216us) server_negotiation.cc:299] Negotiation successful
0807 10:43:30.377006 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 10:43:30.382709 20684 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:30.380626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53942 (local address 127.11.46.129:38715)
0807 10:43:30.380812 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:30.380818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:30.381171 (+ 353us) server_negotiation.cc:407] Connection header received
0807 10:43:30.381339 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:30.381344 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:30.381425 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:30.381575 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:30.382435 (+ 860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53942: BlockingRecv error: recv got EOF from 127.0.0.1:53942 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 10:43:30.382848 11450 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786099355061134-11450-0/krb5kdc/krb5cc' of type FILE
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:30.384588 11450 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:30.386255 11450 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:43:30.402936 20684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:30.387827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53944 (local address 127.11.46.129:38715)
0807 10:43:30.388293 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:30.388302 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:30.388674 (+ 372us) server_negotiation.cc:407] Connection header received
0807 10:43:30.388983 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:30.388989 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:30.389078 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:30.389311 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:30.390606 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.391374 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.392705 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.393153 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.393278 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:30.397320 (+ 4042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:30.397326 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:30.397329 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:30.397375 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:30.400013 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.400744 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.400749 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.400751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.400938 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.401325 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.401329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.401331 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.401690 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:30.402031 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:30.402328 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 10:43:30.402578 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260807 10:43:30.404621 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 20112
I20260807 10:43:30.416896 20684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:30.405372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53950 (local address 127.11.46.129:38715)
0807 10:43:30.405614 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:30.405619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:30.405943 (+ 324us) server_negotiation.cc:407] Connection header received
0807 10:43:30.406109 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:30.406113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:30.406181 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:30.406268 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:30.407247 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.407956 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.409204 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.409703 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.409805 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:30.411875 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:30.411880 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:30.411883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:30.411920 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:30.414337 (+ 2417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.415064 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.415069 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.415071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.415224 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.415564 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.415568 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.415570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.415887 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:30.416113 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:30.416437 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 10:43:30.416625 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260807 10:43:30.417596 20282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:30.508522 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 20112
I20260807 10:43:30.540203 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 20296
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:43:30.556192 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:30.541225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57626 (local address 127.11.46.130:33125)
0807 10:43:30.541909 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:30.541917 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:30.541947 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:43:30.542015 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:30.542022 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:30.542244 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:30.542386 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:30.543373 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.544440 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.545928 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.546536 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.546644 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:30.550512 (+ 3868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:30.550529 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:30.550546 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:30.550588 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:30.553290 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.554095 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.554104 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.554107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.554275 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.554715 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.554718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.554720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.555116 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:30.555380 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:30.555647 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 10:43:30.555877 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":366,"threads_started":1}
I20260807 10:43:30.557648 20472 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:30.643541 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 20296
I20260807 10:43:30.673087 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 20486
Aug 07 10:43:30 dist-test-slave-42z9 krb5kdc[19965](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:43:30.690649 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:30.674251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41096 (local address 127.11.46.131:35659)
0807 10:43:30.674934 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:30.674941 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:30.674973 (+ 32us) server_negotiation.cc:407] Connection header received
0807 10:43:30.675042 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:30.675049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:30.675300 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:30.675464 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:30.676696 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.677924 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.679259 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:30.679903 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:30.680034 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:30.684606 (+ 4572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:30.684627 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:30.684648 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:30.684708 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:30.687618 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.688467 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.688477 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.688479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.688657 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:30.688997 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:30.689000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:30.689002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:30.689509 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:30.689795 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:30.690081 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 10:43:30.690333 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":338,"threads_started":1}
I20260807 10:43:30.692076 20664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:30.778815 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 20486
I20260807 10:43:30.807483 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 19981
I20260807 10:43:30.808990 20063 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:30.919152 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 19981
2026-08-07T10:43:30Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4565 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:43:31 dist-test-slave-42z9 krb5kdc[20718](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:43:31 dist-test-slave-42z9 krb5kdc[20718](info): set up 2 sockets
Aug 07 10:43:31 dist-test-slave-42z9 krb5kdc[20718](info): commencing operation
krb5kdc: starting...
W20260807 10:43:32.166883 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.001s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:43:32 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:43:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:32Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.190.keytab.
Entry for principal oryx/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.190.keytab.
I20260807 10:43:32.464874 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:44715
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.190.keytab
--principal=oryx/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:44715
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:32.835883 20733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:32.836256 20733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:32.836403 20733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:32.844475 20733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:32.844653 20733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:32.844744 20733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:32.844825 20733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:32.844892 20733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:32.855764 20733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:44715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.190.keytab
--principal=oryx/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:44715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:32.857424 20733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:32.859086 20733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:32.872450 20742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:32.872445 20744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:32.872536 20747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:32.873739 20733 server_base.cc:1034] running on GCE node
I20260807 10:43:32.874666 20733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:32.876390 20733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:32.877629 20733 hybrid_clock.cc:648] HybridClock initialized: now 1786099412877558 us; error 59 us; skew 500 ppm
I20260807 10:43:32.878055 20733 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:32 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099412, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:32.882014 20733 init.cc:377] Logged in from keytab as oryx/127.11.46.190@KRBTEST.COM (short username oryx)
I20260807 10:43:32.883895 20733 webserver.cc:460] Webserver started at http://127.11.46.190:32877/ using document root <none> and password file <none>
I20260807 10:43:32.884816 20733 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:32.884963 20733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:32.885341 20733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:32.889042 20733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "b8a1d75033ee46cbae07cad9064b6be1"
format_stamp: "Formatted at 2026-08-07 10:43:32 on dist-test-slave-42z9"
server_key: "d074cb0ab2d8f2fc0454b8350e9faf70"
server_key_iv: "47c7c45b0f1c1e7c5384a5e6530992df"
server_key_version: "encryptionkey@0"
I20260807 10:43:32.890098 20733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "b8a1d75033ee46cbae07cad9064b6be1"
format_stamp: "Formatted at 2026-08-07 10:43:32 on dist-test-slave-42z9"
server_key: "d074cb0ab2d8f2fc0454b8350e9faf70"
server_key_iv: "47c7c45b0f1c1e7c5384a5e6530992df"
server_key_version: "encryptionkey@0"
I20260807 10:43:32.896647 20733 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260807 10:43:32.901012 20756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:32.902626 20733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:43:32.902820 20733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "b8a1d75033ee46cbae07cad9064b6be1"
format_stamp: "Formatted at 2026-08-07 10:43:32 on dist-test-slave-42z9"
server_key: "d074cb0ab2d8f2fc0454b8350e9faf70"
server_key_iv: "47c7c45b0f1c1e7c5384a5e6530992df"
server_key_version: "encryptionkey@0"
I20260807 10:43:32.903045 20733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:32.922363 20733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:32.927222 20733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:32.927502 20733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:32.947794 20733 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:44715
I20260807 10:43:32.947819 20825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:44715 every 8 connection(s)
I20260807 10:43:32.949374 20733 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:32.953755 20826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:32.956677 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 20733
I20260807 10:43:32.956907 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:32.957773 11450 external_mini_cluster.cc:1428] Setting key fa5ee12098f2d8d62e7e921f24b5855a
I20260807 10:43:32.967510 20826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1: Bootstrap starting.
I20260807 10:43:32.971746 20826 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:32.973107 20826 log.cc:824] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1: Log is configured to *not* fsync() on all Append() calls
Aug 07 10:43:32 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:32.976477 20826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1: No bootstrap required, opened a new log
I20260807 10:43:32.982445 20831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:32.960186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54074 (local address 127.11.46.190:44715)
0807 10:43:32.961038 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:32.961051 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:32.961099 (+ 48us) server_negotiation.cc:407] Connection header received
0807 10:43:32.962871 (+ 1772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:32.962898 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:32.963366 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:32.963742 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:32.965584 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:32.966911 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:32.968624 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:32.969338 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:32.969532 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:32.974460 (+ 4928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:32.974474 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:32.974498 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:32.974549 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:32.977809 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:32.978775 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:32.978783 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:32.978790 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:32.978998 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:32.979444 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:32.979448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:32.979450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:32.980082 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:32.980352 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:32.980817 (+ 465us) server_negotiation.cc:299] Negotiation successful
0807 10:43:32.981227 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":379,"threads_started":1}
I20260807 10:43:32.985638 20826 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } }
I20260807 10:43:32.986047 20826 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:32.986147 20826 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8a1d75033ee46cbae07cad9064b6be1, State: Initialized, Role: FOLLOWER
I20260807 10:43:32.986763 20826 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } }
I20260807 10:43:32.986985 20826 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:32.987129 20826 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:32.987279 20826 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:32.989590 20826 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } }
I20260807 10:43:32.990119 20826 leader_election.cc:302] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8a1d75033ee46cbae07cad9064b6be1; no voters:
I20260807 10:43:32.990796 20826 leader_election.cc:288] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:32.990921 20836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:32.991559 20836 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 1 LEADER]: Becoming Leader. State: Replica: b8a1d75033ee46cbae07cad9064b6be1, State: Running, Role: LEADER
I20260807 10:43:32.992218 20836 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } }
I20260807 10:43:32.993201 20826 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:32.995317 20839 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } }
I20260807 10:43:32.995692 20839 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:32.996167 20841 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8a1d75033ee46cbae07cad9064b6be1. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } }
I20260807 10:43:32.996600 20841 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:32.998446 20847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:33.004529 20847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:33.014015 20847 catalog_manager.cc:1347] Generated new cluster ID: efd4533c4e5b4b63888aa197d1f36848
I20260807 10:43:33.014168 20847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:33.031796 20847 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:33.033891 20847 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:33.047452 20847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1: Generated new TSK 0
I20260807 10:43:33.048703 20847 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab.
Entry for principal oryx/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab.
I20260807 10:43:33.116835 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44715
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab
--principal=oryx/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:33.503683 20869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:33.504025 20869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:33.504127 20869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:33.512017 20869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:33.512180 20869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:33.512303 20869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:33.522909 20869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab
--principal=oryx/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44715
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:33.524377 20869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:33.525928 20869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:33.540421 20875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:33.540478 20880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:33.540462 20877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:33.541632 20869 server_base.cc:1034] running on GCE node
I20260807 10:43:33.542315 20869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:33.543524 20869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:33.544806 20869 hybrid_clock.cc:648] HybridClock initialized: now 1786099413544737 us; error 56 us; skew 500 ppm
I20260807 10:43:33.545183 20869 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:33 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099413, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:33.551510 20869 init.cc:377] Logged in from keytab as oryx/127.11.46.129@KRBTEST.COM (short username oryx)
I20260807 10:43:33.553256 20869 webserver.cc:460] Webserver started at http://127.11.46.129:44219/ using document root <none> and password file <none>
I20260807 10:43:33.554114 20869 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:33.554260 20869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:33.554615 20869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:33.558089 20869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "4f6e57e82faa41e78d7f61ada26f5379"
format_stamp: "Formatted at 2026-08-07 10:43:33 on dist-test-slave-42z9"
server_key: "69f7379f27904cc7a6cb4b8b13ad4f74"
server_key_iv: "6a6718ee9d8677ed03089a7fb945887e"
server_key_version: "encryptionkey@0"
I20260807 10:43:33.559056 20869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "4f6e57e82faa41e78d7f61ada26f5379"
format_stamp: "Formatted at 2026-08-07 10:43:33 on dist-test-slave-42z9"
server_key: "69f7379f27904cc7a6cb4b8b13ad4f74"
server_key_iv: "6a6718ee9d8677ed03089a7fb945887e"
server_key_version: "encryptionkey@0"
I20260807 10:43:33.565976 20869 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 10:43:33.570363 20889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:33.572021 20869 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:43:33.572242 20869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "4f6e57e82faa41e78d7f61ada26f5379"
format_stamp: "Formatted at 2026-08-07 10:43:33 on dist-test-slave-42z9"
server_key: "69f7379f27904cc7a6cb4b8b13ad4f74"
server_key_iv: "6a6718ee9d8677ed03089a7fb945887e"
server_key_version: "encryptionkey@0"
I20260807 10:43:33.572494 20869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:33.588791 20869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:33.594025 20869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:33.594339 20869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:33.595582 20869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:33.597265 20869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:33.597362 20869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:33.597532 20869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:33.597596 20869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:33.632540 20869 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:43459
I20260807 10:43:33.632589 21049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:43459 every 8 connection(s)
I20260807 10:43:33.634112 20869 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:33.643463 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 20869
I20260807 10:43:33.643692 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:43:33.644366 11450 external_mini_cluster.cc:1428] Setting key 43dd1db50dba66ed8ce161a13987655e
Aug 07 10:43:33 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099413, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:33.657886 21054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:33.637128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:42719 (local address 127.11.46.190:44715)
0807 10:43:33.637649 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:33.637654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:33.638858 (+ 1204us) server_negotiation.cc:407] Connection header received
0807 10:43:33.641015 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:33.641021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:33.641117 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:33.641227 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:33.643167 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:33.644040 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:33.646076 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:33.646974 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:33.647311 (+ 337us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:33.651470 (+ 4159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:33.651477 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:33.651480 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:33.651522 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:33.654271 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:33.655221 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:33.655226 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:33.655228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:33.655370 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:33.655878 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:33.655882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:33.655884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:33.656186 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:33.656332 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:33.657190 (+ 858us) server_negotiation.cc:299] Negotiation successful
0807 10:43:33.657512 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":239,"threads_started":1}
I20260807 10:43:33.658998 21055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:33.637781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.129:42719)
0807 10:43:33.638652 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:33.638700 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:33.640642 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:33.641583 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:33.641594 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:33.642195 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:33.642925 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:33.642947 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:33.644245 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:33.644250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:33.645893 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:33.645911 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:33.647477 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:33.647487 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:33.647788 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:33.648545 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:33.648574 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:33.651128 (+ 2554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:33.654492 (+ 3364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:33.654502 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:33.654521 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:33.655063 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:33.655496 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:33.655502 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:33.655505 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:33.655746 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:33.656329 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:33.656339 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:33.656762 (+ 423us) client_negotiation.cc:769] Sending connection context
0807 10:43:33.657033 (+ 271us) client_negotiation.cc:240] Negotiation successful
0807 10:43:33.657742 (+ 709us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":324,"threads_started":1}
I20260807 10:43:33.660883 21050 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44715
I20260807 10:43:33.661222 21050 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:33.662160 21050 heartbeater.cc:511] Master 127.11.46.190:44715 requested a full tablet report, sending...
I20260807 10:43:33.664737 20779 ts_manager.cc:194] Registered new tserver with Master: 4f6e57e82faa41e78d7f61ada26f5379 (127.11.46.129:43459)
I20260807 10:43:33.666458 20779 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:42719
WARNING: no policy specified for oryx/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab.
Entry for principal oryx/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab.
I20260807 10:43:33.709043 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44715
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab
--principal=oryx/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:34.097743 21060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:34.098085 21060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:34.098234 21060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:34.106324 21060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:34.106474 21060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:34.106631 21060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:34.118048 21060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab
--principal=oryx/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44715
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:34.119746 21060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:34.121333 21060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:34.136314 21068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:34.136313 21069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:34.136399 21073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:34.137516 21060 server_base.cc:1034] running on GCE node
I20260807 10:43:34.138216 21060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:34.139233 21060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:34.140456 21060 hybrid_clock.cc:648] HybridClock initialized: now 1786099414140397 us; error 45 us; skew 500 ppm
I20260807 10:43:34.140833 21060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:34 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099414, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:34.144253 21060 init.cc:377] Logged in from keytab as oryx/127.11.46.130@KRBTEST.COM (short username oryx)
I20260807 10:43:34.146049 21060 webserver.cc:460] Webserver started at http://127.11.46.130:37117/ using document root <none> and password file <none>
I20260807 10:43:34.146883 21060 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:34.147017 21060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:34.147377 21060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:34.151019 21060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "fa4365b17c51407ea3622f273f296f69"
format_stamp: "Formatted at 2026-08-07 10:43:34 on dist-test-slave-42z9"
server_key: "07b223dc7ee83616fa3574020869e9d9"
server_key_iv: "590ff08a1175ad7d0eeee9187a6802a0"
server_key_version: "encryptionkey@0"
I20260807 10:43:34.151962 21060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "fa4365b17c51407ea3622f273f296f69"
format_stamp: "Formatted at 2026-08-07 10:43:34 on dist-test-slave-42z9"
server_key: "07b223dc7ee83616fa3574020869e9d9"
server_key_iv: "590ff08a1175ad7d0eeee9187a6802a0"
server_key_version: "encryptionkey@0"
I20260807 10:43:34.158380 21060 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 10:43:34.162869 21081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:34.164572 21060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260807 10:43:34.164789 21060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "fa4365b17c51407ea3622f273f296f69"
format_stamp: "Formatted at 2026-08-07 10:43:34 on dist-test-slave-42z9"
server_key: "07b223dc7ee83616fa3574020869e9d9"
server_key_iv: "590ff08a1175ad7d0eeee9187a6802a0"
server_key_version: "encryptionkey@0"
I20260807 10:43:34.165028 21060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:34.179790 21060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:34.184901 21060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:34.185225 21060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:34.186388 21060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:34.188014 21060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:34.188098 21060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:34.188220 21060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:34.188277 21060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:34.223618 21060 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:44463
I20260807 10:43:34.223665 21242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:44463 every 8 connection(s)
I20260807 10:43:34.225087 21060 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:34.231494 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 21060
I20260807 10:43:34.231666 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:43:34.232120 11450 external_mini_cluster.cc:1428] Setting key 2d9809f654c21c3cd01f5e282243c3f3
Aug 07 10:43:34 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099414, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:34.247695 21246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:34.228073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:58703 (local address 127.11.46.190:44715)
0807 10:43:34.228569 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:34.228574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:34.229840 (+ 1266us) server_negotiation.cc:407] Connection header received
0807 10:43:34.231955 (+ 2115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:34.231961 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:34.232065 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:34.232167 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:34.234289 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:34.235042 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:34.236802 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:34.237257 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:34.237374 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:34.241259 (+ 3885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:34.241265 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:34.241268 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:34.241308 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:34.244069 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:34.244985 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:34.244989 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:34.244992 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:34.245141 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:34.245693 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:34.245697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:34.245699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:34.246000 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:34.246148 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:34.246979 (+ 831us) server_negotiation.cc:299] Negotiation successful
0807 10:43:34.247267 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":226,"threads_started":1}
I20260807 10:43:34.248845 21247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:34.228735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.130:58703)
0807 10:43:34.229640 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:34.229699 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:34.231586 (+ 1887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:34.232474 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:34.232486 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:34.233089 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:34.234100 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:34.234128 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:34.235217 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:34.235222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:34.236622 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:34.236638 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:34.237557 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:34.237567 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:34.237812 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:34.238514 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:34.238542 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:34.240959 (+ 2417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:34.244272 (+ 3313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:34.244281 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:34.244300 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:34.244814 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:34.245265 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:34.245270 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:34.245274 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:34.245568 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:34.246145 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:34.246155 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:34.246572 (+ 417us) client_negotiation.cc:769] Sending connection context
0807 10:43:34.246843 (+ 271us) client_negotiation.cc:240] Negotiation successful
0807 10:43:34.247506 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":330,"threads_started":1}
I20260807 10:43:34.250614 21243 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44715
I20260807 10:43:34.250967 21243 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:34.251816 21243 heartbeater.cc:511] Master 127.11.46.190:44715 requested a full tablet report, sending...
I20260807 10:43:34.253541 20779 ts_manager.cc:194] Registered new tserver with Master: fa4365b17c51407ea3622f273f296f69 (127.11.46.130:44463)
I20260807 10:43:34.254420 20779 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:58703
WARNING: no policy specified for oryx/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab.
Entry for principal oryx/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab.
I20260807 10:43:34.296677 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44715
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab
--principal=oryx/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:43:34.670188 21050 heartbeater.cc:503] Master 127.11.46.190:44715 was elected leader, sending a full tablet report...
W20260807 10:43:34.675395 21250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:34.675745 21250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:34.675844 21250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:34.683750 21250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:34.683919 21250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:34.684056 21250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:34.695156 21250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab
--principal=oryx/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44715
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:34.696672 21250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:34.698244 21250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:34.713265 21257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:34.713222 21260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:34.713243 21258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:34.714167 21250 server_base.cc:1034] running on GCE node
I20260807 10:43:34.714998 21250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:34.716238 21250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:34.717541 21250 hybrid_clock.cc:648] HybridClock initialized: now 1786099414717457 us; error 77 us; skew 500 ppm
I20260807 10:43:34.717932 21250 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:34 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099414, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:34.721777 21250 init.cc:377] Logged in from keytab as oryx/127.11.46.131@KRBTEST.COM (short username oryx)
I20260807 10:43:34.723548 21250 webserver.cc:460] Webserver started at http://127.11.46.131:39835/ using document root <none> and password file <none>
I20260807 10:43:34.724427 21250 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:34.724587 21250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:34.724933 21250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:34.728497 21250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "98b4a5b95b0a46d986cdc9cdf8af590d"
format_stamp: "Formatted at 2026-08-07 10:43:34 on dist-test-slave-42z9"
server_key: "4fd3515e5b93012c627744d3d1f9af19"
server_key_iv: "5ebaf7d395d005aec6f2bccd4d85db79"
server_key_version: "encryptionkey@0"
I20260807 10:43:34.729511 21250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "98b4a5b95b0a46d986cdc9cdf8af590d"
format_stamp: "Formatted at 2026-08-07 10:43:34 on dist-test-slave-42z9"
server_key: "4fd3515e5b93012c627744d3d1f9af19"
server_key_iv: "5ebaf7d395d005aec6f2bccd4d85db79"
server_key_version: "encryptionkey@0"
I20260807 10:43:34.735988 21250 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260807 10:43:34.741070 21271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:34.742969 21250 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 10:43:34.743221 21250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "98b4a5b95b0a46d986cdc9cdf8af590d"
format_stamp: "Formatted at 2026-08-07 10:43:34 on dist-test-slave-42z9"
server_key: "4fd3515e5b93012c627744d3d1f9af19"
server_key_iv: "5ebaf7d395d005aec6f2bccd4d85db79"
server_key_version: "encryptionkey@0"
I20260807 10:43:34.743472 21250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:34.768112 21250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:34.772876 21250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:34.773204 21250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:34.774361 21250 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:34.775915 21250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:34.776010 21250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:34.776144 21250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:34.776198 21250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:34.810565 21250 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:37093
I20260807 10:43:34.810663 21430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:37093 every 8 connection(s)
I20260807 10:43:34.812067 21250 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:34.818341 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 21250
I20260807 10:43:34.818543 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:43:34.819010 11450 external_mini_cluster.cc:1428] Setting key 65f97b7471b92b06485d6ef9fbd38533
Aug 07 10:43:34 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099414, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:34.835414 21434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:34.815040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:41375 (local address 127.11.46.190:44715)
0807 10:43:34.815613 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:34.815619 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:34.816827 (+ 1208us) server_negotiation.cc:407] Connection header received
0807 10:43:34.819057 (+ 2230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:34.819062 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:34.819178 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:34.819281 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:34.821468 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:34.822436 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:34.824229 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:34.824681 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:34.824800 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:34.828806 (+ 4006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:34.828812 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:34.828815 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:34.828858 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:34.831532 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:34.832459 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:34.832464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:34.832466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:34.832616 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:34.833113 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:34.833117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:34.833119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:34.833523 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:34.833697 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:34.834781 (+ 1084us) server_negotiation.cc:299] Negotiation successful
0807 10:43:34.835030 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":240,"threads_started":1}
I20260807 10:43:34.836683 21435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:34.815723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.131:41375)
0807 10:43:34.816609 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:34.816662 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:34.818691 (+ 2029us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:34.819654 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:34.819669 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:34.820358 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:34.821231 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:34.821260 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:34.822641 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:34.822646 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:34.824032 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:34.824051 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:34.824964 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:34.824974 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:34.825229 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:34.826028 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:34.826057 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:34.828500 (+ 2443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:34.831745 (+ 3245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:34.831756 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:34.831775 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:34.832313 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:34.832742 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:34.832748 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:34.832752 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:34.832988 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:34.833722 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:34.833732 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:34.834278 (+ 546us) client_negotiation.cc:769] Sending connection context
0807 10:43:34.834627 (+ 349us) client_negotiation.cc:240] Negotiation successful
0807 10:43:34.835286 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":327,"threads_started":1}
I20260807 10:43:34.838236 21431 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44715
I20260807 10:43:34.838568 21431 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:34.839412 21431 heartbeater.cc:511] Master 127.11.46.190:44715 requested a full tablet report, sending...
I20260807 10:43:34.841144 20779 ts_manager.cc:194] Registered new tserver with Master: 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093)
I20260807 10:43:34.842075 20779 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:41375
I20260807 10:43:34.848867 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.46.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.189.keytab.
Entry for principal oryx/127.11.46.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.189.keytab.
I20260807 10:43:34.917361 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.189:34107
--webserver_interface=127.11.46.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.189.keytab
--principal=oryx/127.11.46.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:44715,127.11.46.189:34107
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:43:35.257863 21243 heartbeater.cc:503] Master 127.11.46.190:44715 was elected leader, sending a full tablet report...
W20260807 10:43:35.304745 21440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:35.305121 21440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:35.305246 21440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:35.313305 21440 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:35.313519 21440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:35.313611 21440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:35.313685 21440 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:35.313745 21440 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:35.324698 21440 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:44715,127.11.46.189:34107
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.189.keytab
--principal=oryx/127.11.46.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.189:34107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.46.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
W20260807 10:43:35.325166 21440 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.46.190:44715,127.11.46.189:34107'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 10:43:35.326488 21440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:35.328040 21440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:35.342250 21450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:35.342172 21451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:35.342208 21453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:35.343355 21440 server_base.cc:1034] running on GCE node
I20260807 10:43:35.344319 21440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:35.346076 21440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:35.347323 21440 hybrid_clock.cc:648] HybridClock initialized: now 1786099415347260 us; error 38 us; skew 500 ppm
I20260807 10:43:35.347708 21440 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:35 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099415, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:35.351256 21440 init.cc:377] Logged in from keytab as oryx/127.11.46.189@KRBTEST.COM (short username oryx)
I20260807 10:43:35.353093 21440 webserver.cc:460] Webserver started at http://127.11.46.189:40933/ using document root <none> and password file <none>
I20260807 10:43:35.354025 21440 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:35.354171 21440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:35.354548 21440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:35.357985 21440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data/instance:
uuid: "47dafdcdc8314ab1bf7eb00498241cc0"
format_stamp: "Formatted at 2026-08-07 10:43:35 on dist-test-slave-42z9"
server_key: "56faee070d72efedd6f694fbaed37c7e"
server_key_iv: "71542ddacd25f8cf2f5c44c4aff6a68f"
server_key_version: "encryptionkey@0"
I20260807 10:43:35.358870 21440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal/instance:
uuid: "47dafdcdc8314ab1bf7eb00498241cc0"
format_stamp: "Formatted at 2026-08-07 10:43:35 on dist-test-slave-42z9"
server_key: "56faee070d72efedd6f694fbaed37c7e"
server_key_iv: "71542ddacd25f8cf2f5c44c4aff6a68f"
server_key_version: "encryptionkey@0"
I20260807 10:43:35.365149 21440 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260807 10:43:35.369423 21463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:35.371214 21440 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:35.371444 21440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal
uuid: "47dafdcdc8314ab1bf7eb00498241cc0"
format_stamp: "Formatted at 2026-08-07 10:43:35 on dist-test-slave-42z9"
server_key: "56faee070d72efedd6f694fbaed37c7e"
server_key_iv: "71542ddacd25f8cf2f5c44c4aff6a68f"
server_key_version: "encryptionkey@0"
I20260807 10:43:35.371702 21440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:35.388095 21440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:35.392855 21440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:35.393224 21440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:35.412905 21440 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.189:34107
I20260807 10:43:35.412927 21529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.189:34107 every 8 connection(s)
I20260807 10:43:35.414448 21440 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
I20260807 10:43:35.418565 21531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:35.420796 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 21440
I20260807 10:43:35.428735 21531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:43:35 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.189@KRBTEST.COM
Aug 07 10:43:35 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099415, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.189@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:35.448469 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.423463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47044 (local address 127.11.46.189:34107)
0807 10:43:35.424346 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:35.424360 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:35.424412 (+ 52us) server_negotiation.cc:407] Connection header received
0807 10:43:35.426163 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:35.426198 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:35.426703 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:35.427125 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:35.428889 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.430378 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.432308 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.433666 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.433872 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.438937 (+ 5065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:35.438947 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:35.438972 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:35.439034 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:35.443072 (+ 4038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.444166 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.444174 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.444183 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.444368 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.444828 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.444832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.444834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.445598 (+ 764us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:35.445892 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:35.446434 (+ 542us) server_negotiation.cc:299] Negotiation successful
0807 10:43:35.446886 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":397,"threads_started":1}
I20260807 10:43:35.450780 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.431626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:54082)
0807 10:43:35.432924 (+ 1298us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:35.433001 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:35.433210 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:35.433870 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:35.433879 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:35.434671 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:35.435201 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.435220 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.436945 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.436952 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.438258 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.438279 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.439211 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.439217 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.439478 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.440275 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:35.440304 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:35.443452 (+ 3148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:35.447331 (+ 3879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.447343 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.447352 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.448010 (+ 658us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.448430 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.448436 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.448439 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.448664 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.449490 (+ 826us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:35.449500 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:35.449724 (+ 224us) client_negotiation.cc:769] Sending connection context
0807 10:43:35.449928 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 10:43:35.450343 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"thread_start_us":458,"threads_started":1}
I20260807 10:43:35.452111 21538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.431781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54082 (local address 127.11.46.190:44715)
0807 10:43:35.433483 (+ 1702us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:35.433489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:35.433510 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:43:35.433570 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:35.433574 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:35.433650 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:35.433748 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:35.435453 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.436692 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.438457 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.439006 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.439111 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.443789 (+ 4678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:35.443797 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:35.443802 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:35.443862 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:35.447172 (+ 3310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.448142 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.448147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.448149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.448287 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.448869 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.448874 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.448878 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.449318 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:35.449493 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:35.451448 (+ 1955us) server_negotiation.cc:299] Negotiation successful
0807 10:43:35.451740 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1560,"thread_start_us":1430,"threads_started":1}
I20260807 10:43:35.453891 21531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:43:35 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099415, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.189@KRBTEST.COM for oryx/127.11.46.189@KRBTEST.COM
I20260807 10:43:35.467239 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.454740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:34107 (local address 127.0.0.1:47046)
0807 10:43:35.454940 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:35.454960 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:35.455072 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:35.455338 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:35.455341 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:35.455701 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:35.455863 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.455873 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.456844 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.456847 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.457790 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.457803 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.458566 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.458571 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.458707 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.459285 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:35.459303 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:35.461641 (+ 2338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:35.464945 (+ 3304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.464949 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.464952 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.465389 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.465797 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.465800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.465803 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.465938 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.466465 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:35.466468 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:35.466623 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 10:43:35.466731 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 10:43:35.466972 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 10:43:35.467463 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.454691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47046 (local address 127.11.46.189:34107)
0807 10:43:35.454859 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:35.454863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:35.455019 (+ 156us) server_negotiation.cc:407] Connection header received
0807 10:43:35.455161 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:35.455165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:35.455230 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:35.455315 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:35.455996 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.456709 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.457966 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.458408 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.458526 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.461883 (+ 3357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:35.461888 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:35.461892 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:35.461937 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:35.464754 (+ 2817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.465556 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.465561 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.465563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.465700 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.466041 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.466044 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.466046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.466368 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:35.466482 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:35.466894 (+ 412us) server_negotiation.cc:299] Negotiation successful
0807 10:43:35.467113 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 10:43:35.472891 21531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: Bootstrap starting.
I20260807 10:43:35.476687 21531 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:35.478132 21531 log.cc:824] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:35.482230 21531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: No bootstrap required, opened a new log
I20260807 10:43:35.491787 21531 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } }
I20260807 10:43:35.492501 21531 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:35.492635 21531 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47dafdcdc8314ab1bf7eb00498241cc0, State: Initialized, Role: FOLLOWER
I20260807 10:43:35.493572 21531 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } }
I20260807 10:43:35.494870 21541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } } }
I20260807 10:43:35.495296 21541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:43:35.496701 21531 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 10:43:35.508579 21555 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:43:35.508765 21555 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:43:35.513636 21440 master_runner.cc:428] Detected that this master 47dafdcdc8314ab1bf7eb00498241cc0 is joining an existing cluster
I20260807 10:43:35.513778 21440 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.46.189:34107
I20260807 10:43:35.539693 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.521867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47054 (local address 127.11.46.189:34107)
0807 10:43:35.522088 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:35.522094 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:35.523032 (+ 938us) server_negotiation.cc:407] Connection header received
0807 10:43:35.523244 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:35.523249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:35.523315 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:35.523398 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:35.524992 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.526113 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.528068 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.528749 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.528838 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.531767 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:35.531774 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:35.531777 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:35.531819 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:35.536288 (+ 4469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.537111 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.537117 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.537120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.537278 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.537763 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.537768 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.537771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.538153 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:35.538284 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:35.538867 (+ 583us) server_negotiation.cc:299] Negotiation successful
0807 10:43:35.539305 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":196,"server-negotiator.queue_time_us":63}
I20260807 10:43:35.540129 21538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.521005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54084 (local address 127.11.46.190:44715)
0807 10:43:35.521214 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:35.521221 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:35.522287 (+ 1066us) server_negotiation.cc:407] Connection header received
0807 10:43:35.522496 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:35.522503 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:35.522611 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:35.522711 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:35.524454 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.525640 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.527860 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.528561 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.528673 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.531825 (+ 3152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:35.531832 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:35.531836 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:35.531879 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:35.536050 (+ 4171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.537012 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.537018 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.537021 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.537219 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.537766 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.537771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.537774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.538164 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:35.538308 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:35.539524 (+ 1216us) server_negotiation.cc:299] Negotiation successful
0807 10:43:35.539806 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:43:35.540699 21567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.521131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:54084)
0807 10:43:35.522162 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:35.522184 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:35.522351 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:35.522921 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:35.522926 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:35.523741 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:35.524237 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.524259 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.525847 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.525852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.527641 (+ 1789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.527659 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.529038 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.529044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.529227 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.530034 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:35.530067 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:35.531615 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:35.536271 (+ 4656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.536277 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.536281 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.536846 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.537370 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.537375 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.537378 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.537616 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.538376 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:35.538380 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:35.538583 (+ 203us) client_negotiation.cc:769] Sending connection context
0807 10:43:35.538729 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 10:43:35.539111 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":893,"mutex_wait_us":26,"spinlock_wait_cycles":35712,"thread_start_us":476,"threads_started":1}
I20260807 10:43:35.540733 21568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.521407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:34107 (local address 127.0.0.1:47054)
0807 10:43:35.522943 (+ 1536us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:35.522961 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:35.523113 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:35.523610 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:35.523615 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:35.524478 (+ 863us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:35.524826 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.524839 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.526344 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.526349 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.527939 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.527954 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.529153 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.529159 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.529314 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.530132 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:35.530149 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:35.531556 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:35.536452 (+ 4896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.536457 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.536461 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.537003 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.537402 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.537406 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.537408 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.537650 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.538364 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:35.538369 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:35.538583 (+ 214us) client_negotiation.cc:769] Sending connection context
0807 10:43:35.538956 (+ 373us) client_negotiation.cc:240] Negotiation successful
0807 10:43:35.540192 (+ 1236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1385,"mutex_wait_us":995,"spinlock_wait_cycles":51328,"thread_start_us":611,"threads_started":1}
WARNING: no policy specified for oryx/127.11.46.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.188@KRBTEST.COM" created.
Aug 07 10:43:35 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099412, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.190@KRBTEST.COM for oryx/127.11.46.189@KRBTEST.COM
I20260807 10:43:35.566100 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.547437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47066 (local address 127.11.46.189:34107)
0807 10:43:35.547631 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:35.547637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:35.548292 (+ 655us) server_negotiation.cc:407] Connection header received
0807 10:43:35.548614 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:35.548620 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:35.548720 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:35.548822 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:35.550444 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.551533 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.553372 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.554067 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.554177 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.559029 (+ 4852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:35.559036 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:35.559040 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:35.559085 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:35.562674 (+ 3589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.563559 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.563566 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.563570 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.563727 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.564194 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.564199 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.564202 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.564612 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:35.564720 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:35.565402 (+ 682us) server_negotiation.cc:299] Negotiation successful
0807 10:43:35.565713 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:43:35.566157 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.547452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:34107 (local address 127.0.0.1:47066)
0807 10:43:35.548148 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:35.548199 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:35.548393 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:35.548924 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:35.548934 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:35.549919 (+ 985us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:35.550234 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.550248 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.551746 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.551751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.553187 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.553204 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.554501 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.554506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.554722 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.555600 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:35.555636 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:35.558718 (+ 3082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:35.562875 (+ 4157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.562898 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.562906 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.563418 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.563856 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.563862 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.563866 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.564041 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.564829 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:35.564837 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:35.565048 (+ 211us) client_negotiation.cc:769] Sending connection context
0807 10:43:35.565230 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 10:43:35.565707 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":249,"threads_started":1}
I20260807 10:43:35.568487 20779 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.46.189:34107: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0"
member_type: NON_VOTER
last_known_addr {
host: "127.11.46.189"
port: 34107
}
attrs {
promote: true
}
}
dest_uuid: "b8a1d75033ee46cbae07cad9064b6be1"
cas_config_opid_index: -1
I20260807 10:43:35.569823 20779 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } }
I20260807 10:43:35.582886 21576 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 47dafdcdc8314ab1bf7eb00498241cc0 (127.11.46.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } } }
I20260807 10:43:35.584267 21498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:35.589807 21498 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 FOLLOWER]: Refusing update from remote peer b8a1d75033ee46cbae07cad9064b6be1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 10:43:35.591396 21577 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:35.592730 21576 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.46.189:34107
I20260807 10:43:35.594022 21440 master.cc:537] Master@127.11.46.189:34107 shutting down...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.188.keytab.
Entry for principal oryx/127.11.46.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.188.keytab.
I20260807 10:43:35.596179 21578 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } } }
I20260807 10:43:35.596529 21578 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:35.598012 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.188:41877
--webserver_interface=127.11.46.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.188.keytab
--principal=oryx/127.11.46.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:44715,127.11.46.189:34107,127.11.46.188:41877
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:35.598307 20759 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260807 10:43:35.606585 20759 consensus_peers.cc:487] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 -> Peer 47dafdcdc8314ab1bf7eb00498241cc0 (127.11.46.189:34107): Couldn't send request to peer 47dafdcdc8314ab1bf7eb00498241cc0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 10:43:35.617862 21440 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:35.618414 21440 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:35.618631 21440 tablet_replica.cc:330] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: stopping tablet replica
I20260807 10:43:35.625329 21440 master.cc:552] Master@127.11.46.189:34107 shutdown complete.
I20260807 10:43:35.625468 21440 master_runner.cc:305] Clearing existing system tablet
I20260807 10:43:35.625878 21440 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:35.625998 21440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:35.628504 21440 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 10:43:35.630244 21584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:35.630628 21440 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:35.630908 21440 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 10:43:35.631008 21440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal
uuid: "47dafdcdc8314ab1bf7eb00498241cc0"
format_stamp: "Formatted at 2026-08-07 10:43:35 on dist-test-slave-42z9"
server_key: "56faee070d72efedd6f694fbaed37c7e"
server_key_iv: "71542ddacd25f8cf2f5c44c4aff6a68f"
server_key_version: "encryptionkey@0"
I20260807 10:43:35.636348 21440 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:35.642014 21440 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 10:43:35.642239 21440 log.cc:1196] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 10:43:35.642709 21440 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: Deleting consensus metadata
I20260807 10:43:35.642977 21440 master_runner.cc:315] Copying system tablet from 127.11.46.190:44715
I20260807 10:43:35.645686 21440 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: tablet copy: Beginning tablet copy session from remote peer at address 127.11.46.190:44715
I20260807 10:43:35.660513 21538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.646579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54092 (local address 127.11.46.190:44715)
0807 10:43:35.646782 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:35.646789 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:35.647282 (+ 493us) server_negotiation.cc:407] Connection header received
0807 10:43:35.647528 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:35.647533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:35.647612 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:35.647700 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:35.649189 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.650339 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.652084 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.652568 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.652709 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.654825 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:35.654831 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:35.654834 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:35.654874 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:35.657625 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.658371 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.658375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.658378 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.658525 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:35.658922 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:35.658927 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:35.658930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:35.659262 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:35.659443 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:35.659865 (+ 422us) server_negotiation.cc:299] Negotiation successful
0807 10:43:35.660101 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:43:35.660542 21590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:35.646534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:54092)
0807 10:43:35.647148 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:35.647168 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:35.647333 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:35.647908 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:35.647911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:35.648384 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:35.648801 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.648863 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.650559 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.650565 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.651763 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:35.651792 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:35.652767 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:35.652779 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:35.653002 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:35.653686 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:35.653707 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:35.654558 (+ 851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:35.657795 (+ 3237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.657801 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.657806 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.658240 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.658641 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:35.658647 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:35.658651 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:35.658809 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:35.659408 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:35.659413 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:35.659603 (+ 190us) client_negotiation.cc:769] Sending connection context
0807 10:43:35.659729 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 10:43:35.660098 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":378,"threads_started":1}
I20260807 10:43:35.661783 20807 tablet_copy_service.cc:140] P b8a1d75033ee46cbae07cad9064b6be1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 47dafdcdc8314ab1bf7eb00498241cc0 ({username='oryx', principal='oryx/127.11.46.189@KRBTEST.COM'} at 127.0.0.1:54092)
I20260807 10:43:35.662077 20807 tablet_copy_service.cc:161] P b8a1d75033ee46cbae07cad9064b6be1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 47dafdcdc8314ab1bf7eb00498241cc0 at {username='oryx', principal='oryx/127.11.46.189@KRBTEST.COM'} at 127.0.0.1:54092: session id = 47dafdcdc8314ab1bf7eb00498241cc0-00000000000000000000000000000000
I20260807 10:43:35.665306 20807 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 10:43:35.667603 21440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 10:43:35.673070 21440 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: tablet copy: Starting download of 0 data blocks...
I20260807 10:43:35.673491 21440 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: tablet copy: Starting download of 1 WAL segments...
I20260807 10:43:35.676398 21440 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 10:43:35.680191 20807 tablet_copy_service.cc:342] P b8a1d75033ee46cbae07cad9064b6be1: Request end of tablet copy session 47dafdcdc8314ab1bf7eb00498241cc0-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.46.189@KRBTEST.COM'} at 127.0.0.1:54092
I20260807 10:43:35.680398 20807 tablet_copy_service.cc:433] P b8a1d75033ee46cbae07cad9064b6be1: ending tablet copy session 47dafdcdc8314ab1bf7eb00498241cc0-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 47dafdcdc8314ab1bf7eb00498241cc0
I20260807 10:43:35.691045 21440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:35.693771 21591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:35.706233 21592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:35.706396 21594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:35.707151 21440 server_base.cc:1034] running on GCE node
I20260807 10:43:35.707568 21440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:35.708420 21440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:35.709686 21440 hybrid_clock.cc:648] HybridClock initialized: now 1786099415709597 us; error 66 us; skew 500 ppm
I20260807 10:43:35.709939 21440 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:35 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099415, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:35.711773 21440 init.cc:377] Logged in from keytab as oryx/127.11.46.189@KRBTEST.COM (short username oryx)
I20260807 10:43:35.713049 21440 webserver.cc:460] Webserver started at http://127.11.46.189:42391/ using document root <none> and password file <none>
I20260807 10:43:35.713393 21440 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:35.713505 21440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:35.716145 21440 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260807 10:43:35.717972 21601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:35.718482 21440 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 10:43:35.718632 21440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal
uuid: "47dafdcdc8314ab1bf7eb00498241cc0"
format_stamp: "Formatted at 2026-08-07 10:43:35 on dist-test-slave-42z9"
server_key: "56faee070d72efedd6f694fbaed37c7e"
server_key_iv: "71542ddacd25f8cf2f5c44c4aff6a68f"
server_key_version: "encryptionkey@0"
I20260807 10:43:35.718804 21440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:35.758778 21440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:35.762315 21440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:35.791723 21440 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.189:34107
I20260807 10:43:35.791769 21668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.189:34107 every 8 connection(s)
I20260807 10:43:35.792886 21440 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
I20260807 10:43:35.799072 21669 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:43:35.802625 21669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: Bootstrap starting.
I20260807 10:43:35.821956 21669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:43:35.822449 21669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: Bootstrap complete.
I20260807 10:43:35.823378 21669 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } }
I20260807 10:43:35.823621 21669 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 47dafdcdc8314ab1bf7eb00498241cc0, State: Initialized, Role: LEARNER
I20260807 10:43:35.823881 21669 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } }
I20260807 10:43:35.824714 21674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } } }
I20260807 10:43:35.825044 21669 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:35.825157 21674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: This master's current role is: LEARNER
I20260807 10:43:35.836820 21687 catalog_manager.cc:1259] Loaded cluster ID: efd4533c4e5b4b63888aa197d1f36848
I20260807 10:43:35.836941 21687 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: loading cluster ID for follower catalog manager: success
I20260807 10:43:35.839747 21687 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: acquiring CA information for follower catalog manager: success
I20260807 10:43:35.842024 21687 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:43:35.845116 21431 heartbeater.cc:503] Master 127.11.46.190:44715 was elected leader, sending a full tablet report...
W20260807 10:43:36.073413 21582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:36.073848 21582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:36.073987 21582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:36.082338 21582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:36.082522 21582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:36.082610 21582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:36.082695 21582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:36.082765 21582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:36.094023 21582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:44715,127.11.46.189:34107,127.11.46.188:41877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.188.keytab
--principal=oryx/127.11.46.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.188:41877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.46.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:36.095703 21582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:36.097237 21582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:36.111212 21695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:36.111289 21696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:36.111246 21699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:36.117944 21582 server_base.cc:1034] running on GCE node
I20260807 10:43:36.119031 21582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:36.120883 21582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:36.122128 21582 hybrid_clock.cc:648] HybridClock initialized: now 1786099416122050 us; error 63 us; skew 500 ppm
I20260807 10:43:36.122547 21582 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:36 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:36.126215 21582 init.cc:377] Logged in from keytab as oryx/127.11.46.188@KRBTEST.COM (short username oryx)
I20260807 10:43:36.128096 21582 webserver.cc:460] Webserver started at http://127.11.46.188:42087/ using document root <none> and password file <none>
I20260807 10:43:36.129007 21582 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:36.129153 21582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:36.129570 21582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:36.133220 21582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data/instance:
uuid: "051db34e187143b5bd6d02ddb1bf6f4a"
format_stamp: "Formatted at 2026-08-07 10:43:36 on dist-test-slave-42z9"
server_key: "549cf48b3af4e32ff70054838c2be06a"
server_key_iv: "40f1c5ba57d6ab9e1a17726b59f8ffa4"
server_key_version: "encryptionkey@0"
I20260807 10:43:36.134258 21582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal/instance:
uuid: "051db34e187143b5bd6d02ddb1bf6f4a"
format_stamp: "Formatted at 2026-08-07 10:43:36 on dist-test-slave-42z9"
server_key: "549cf48b3af4e32ff70054838c2be06a"
server_key_iv: "40f1c5ba57d6ab9e1a17726b59f8ffa4"
server_key_version: "encryptionkey@0"
I20260807 10:43:36.141166 21582 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 10:43:36.145578 21714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:36.147356 21582 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:36.147578 21582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal
uuid: "051db34e187143b5bd6d02ddb1bf6f4a"
format_stamp: "Formatted at 2026-08-07 10:43:36 on dist-test-slave-42z9"
server_key: "549cf48b3af4e32ff70054838c2be06a"
server_key_iv: "40f1c5ba57d6ab9e1a17726b59f8ffa4"
server_key_version: "encryptionkey@0"
I20260807 10:43:36.147823 21582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:36.179713 21582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:36.186560 21582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:36.186939 21582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:36.209380 21582 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.188:41877
I20260807 10:43:36.209398 21800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.188:41877 every 8 connection(s)
I20260807 10:43:36.211004 21582 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
I20260807 10:43:36.215514 21796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.208644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47070 (local address 127.11.46.189:34107)
0807 10:43:36.209409 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.209413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.209430 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:43:36.209539 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.209543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.209649 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.209787 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:36.210245 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.211364 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.213134 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.214047 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.214184 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.214508 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.215093 (+ 585us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.215219 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":542,"threads_started":1}
I20260807 10:43:36.215663 21794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.208043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:34107 (local address 127.0.0.1:47070)
0807 10:43:36.208709 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:36.208732 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:36.208907 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:36.209848 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:36.209854 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:36.209896 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:36.210101 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.210112 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.211516 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.211521 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.212962 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.212977 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.214265 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.214273 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.214714 (+ 441us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.214851 (+ 137us) client_negotiation.cc:769] Sending connection context
0807 10:43:36.215064 (+ 213us) client_negotiation.cc:240] Negotiation successful
0807 10:43:36.215265 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":845,"threads_started":1}
I20260807 10:43:36.216563 21801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:36.216966 21635 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260807 10:43:36.217648 21674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8a1d75033ee46cbae07cad9064b6be1. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } } }
I20260807 10:43:36.217957 21674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: This master's current role is: LEARNER
I20260807 10:43:36.218523 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 21582
I20260807 10:43:36.227407 21801 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:43:36 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.188@KRBTEST.COM
Aug 07 10:43:36 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.188@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:36.245150 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.220935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45630 (local address 127.11.46.188:41877)
0807 10:43:36.221943 (+ 1008us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.221959 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.222008 (+ 49us) server_negotiation.cc:407] Connection header received
0807 10:43:36.223678 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.223704 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.224173 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.224633 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:36.226306 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.227754 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.229111 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.229917 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.230113 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.235841 (+ 5728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:36.235852 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:36.235874 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:36.235923 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:36.239325 (+ 3402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.240275 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.240287 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.240298 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.240558 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.241034 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.241039 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.241043 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.241985 (+ 942us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:36.242370 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.242830 (+ 460us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.243438 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":565,"threads_started":1}
I20260807 10:43:36.247958 21807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.230591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54094 (local address 127.11.46.190:44715)
0807 10:43:36.231287 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.231293 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.231622 (+ 329us) server_negotiation.cc:407] Connection header received
0807 10:43:36.231849 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.231855 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.231931 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.232024 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:36.233252 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.234120 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.236015 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.236476 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.236593 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.240497 (+ 3904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:36.240505 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:36.240510 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:36.240561 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:36.244516 (+ 3955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.245487 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.245493 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.245497 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.245686 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.246202 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.246207 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.246210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.246621 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:36.246788 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.247400 (+ 612us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.247620 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":421,"threads_started":1}
I20260807 10:43:36.248224 21806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.230450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:54094)
0807 10:43:36.231447 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:36.231506 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:36.231721 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:36.232124 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:36.232132 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:36.232805 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:36.233081 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.233091 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.234269 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.234275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.235864 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.235880 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.236676 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.236683 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.236902 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.237602 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:36.237627 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:36.240210 (+ 2583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:36.244707 (+ 4497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.244720 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.244726 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.245271 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.245886 (+ 615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.245890 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.245892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.246055 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.246770 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:36.246784 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:36.247032 (+ 248us) client_negotiation.cc:769] Sending connection context
0807 10:43:36.247305 (+ 273us) client_negotiation.cc:240] Negotiation successful
0807 10:43:36.247720 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":711,"thread_start_us":546,"threads_started":1}
I20260807 10:43:36.249953 21801 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:43:36 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.188@KRBTEST.COM for oryx/127.11.46.189@KRBTEST.COM
I20260807 10:43:36.263942 21806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.250819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:34107 (local address 127.0.0.1:47080)
0807 10:43:36.251032 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:36.251051 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:36.251155 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:36.251442 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:36.251445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:36.251814 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:36.251985 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.251993 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.253108 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.253113 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.254300 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.254318 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.255050 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.255054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.255191 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.255858 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:36.255879 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:36.258151 (+ 2272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:36.261342 (+ 3191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.261348 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.261351 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.261894 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.262414 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.262418 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.262421 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.262613 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.263142 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:36.263145 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:36.263289 (+ 144us) client_negotiation.cc:769] Sending connection context
0807 10:43:36.263396 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 10:43:36.263676 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 10:43:36.263981 21796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.250827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47080 (local address 127.11.46.189:34107)
0807 10:43:36.251045 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.251051 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.251099 (+ 48us) server_negotiation.cc:407] Connection header received
0807 10:43:36.251252 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.251255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.251325 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.251408 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:36.252128 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.252956 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.254450 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.254904 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.255013 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.258391 (+ 3378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:36.258397 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:36.258401 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:36.258442 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:36.261164 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.262064 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.262071 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.262074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.262276 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.262721 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.262725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.262727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.263047 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:36.263173 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.263496 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.263713 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:43:36.265069 21801 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:43:36 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.188@KRBTEST.COM for oryx/127.11.46.188@KRBTEST.COM
I20260807 10:43:36.278316 21806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.265840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:41877 (local address 127.0.0.1:45636)
0807 10:43:36.266071 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:36.266089 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:36.266183 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:36.266463 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:36.266466 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:36.266842 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:36.267032 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.267041 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.268009 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.268013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.268877 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.268889 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.269679 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.269684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.269850 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.270423 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:36.270442 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:36.272709 (+ 2267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:36.275702 (+ 2993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.275707 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.275710 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.276130 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.276572 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.276576 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.276578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.276772 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.277319 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:36.277323 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:36.277562 (+ 239us) client_negotiation.cc:769] Sending connection context
0807 10:43:36.277683 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 10:43:36.277959 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 10:43:36.278398 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.266075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45636 (local address 127.11.46.188:41877)
0807 10:43:36.266221 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.266225 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.266241 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:43:36.266284 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.266288 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.266355 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.266433 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:36.267170 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.267888 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.269023 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.269512 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.269643 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.272929 (+ 3286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:36.272935 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:36.272939 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:36.272975 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:36.275531 (+ 2556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.276277 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.276282 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.276285 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.276449 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.276881 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.276885 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.276887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.277214 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:36.277334 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.277809 (+ 475us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.278102 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":47}
I20260807 10:43:36.283795 21801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Bootstrap starting.
I20260807 10:43:36.287603 21801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:36.288901 21801 log.cc:824] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:36.292356 21801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: No bootstrap required, opened a new log
I20260807 10:43:36.300688 21801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } }
I20260807 10:43:36.301163 21801 raft_consensus.cc:374] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:36.301304 21801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051db34e187143b5bd6d02ddb1bf6f4a, State: Initialized, Role: FOLLOWER
I20260807 10:43:36.302079 21801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } }
I20260807 10:43:36.303128 21810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } } }
I20260807 10:43:36.303566 21810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:43:36.304433 21801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: configured and running, proceeding with master startup.
W20260807 10:43:36.315294 21824 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:43:36.315570 21824 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:43:36.322810 21582 master_runner.cc:428] Detected that this master 051db34e187143b5bd6d02ddb1bf6f4a is joining an existing cluster
I20260807 10:43:36.322985 21582 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.46.188:41877
I20260807 10:43:36.349944 21807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.328281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54104 (local address 127.11.46.190:44715)
0807 10:43:36.328840 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.328846 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.329380 (+ 534us) server_negotiation.cc:407] Connection header received
0807 10:43:36.329744 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.329749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.329857 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.329938 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:36.332077 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.333420 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.336552 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.337333 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.337478 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.342151 (+ 4673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:36.342160 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:36.342166 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:36.342222 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:36.345935 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.346869 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.346875 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.346879 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.347136 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.347839 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.347844 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.347847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.348256 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:36.348478 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.349243 (+ 765us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.349542 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416}
I20260807 10:43:36.351189 21833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.328255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:54104)
0807 10:43:36.329259 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:36.329280 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:36.329551 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:36.330431 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:36.330436 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:36.331371 (+ 935us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:36.331826 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.331843 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.333770 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.333777 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.336294 (+ 2517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.336322 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.338330 (+ 2008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.338338 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.338604 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.339513 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:36.339541 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:36.341318 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:36.346123 (+ 4805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.346133 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.346137 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.346710 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.347398 (+ 688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.347403 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.347408 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.347685 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.348586 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:36.348591 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:36.348853 (+ 262us) client_negotiation.cc:769] Sending connection context
0807 10:43:36.350263 (+ 1410us) client_negotiation.cc:240] Negotiation successful
0807 10:43:36.350651 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"spinlock_wait_cycles":45952,"thread_start_us":576,"threads_started":1}
I20260807 10:43:36.352618 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 20869
I20260807 10:43:36.361387 21796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.328319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47086 (local address 127.11.46.189:34107)
0807 10:43:36.328530 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.328537 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.339512 (+ 10975us) server_negotiation.cc:407] Connection header received
0807 10:43:36.340020 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.340026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.340122 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.340200 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:36.342199 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.343601 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.345602 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.346255 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.346357 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.349228 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:36.349234 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:36.349239 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:36.349286 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:36.352673 (+ 3387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.358529 (+ 5856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.358535 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.358539 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.358754 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.359290 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.359296 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.359299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.359757 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:36.359914 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.360648 (+ 734us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.360971 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:43:36.362641 21835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.328753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:34107 (local address 127.0.0.1:47086)
0807 10:43:36.339369 (+ 10616us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:36.339393 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:36.339832 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:36.340444 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:36.340448 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:36.341581 (+ 1133us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:36.342022 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.342034 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.343765 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.343770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.345402 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.345419 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.346689 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.346699 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.346857 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.347621 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:36.347649 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:36.348993 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:36.352859 (+ 3866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.352864 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.352867 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.358330 (+ 5463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.358926 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.358931 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.358934 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.359154 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.360016 (+ 862us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:36.360021 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:36.360311 (+ 290us) client_negotiation.cc:769] Sending connection context
0807 10:43:36.361742 (+ 1431us) client_negotiation.cc:240] Negotiation successful
0807 10:43:36.362148 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10376,"spinlock_wait_cycles":35072,"thread_start_us":12579,"threads_started":1}
I20260807 10:43:36.363705 21834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.329513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:41877 (local address 127.0.0.1:45640)
0807 10:43:36.341753 (+ 12240us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:36.341775 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:36.341912 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:36.342385 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:36.342389 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:36.343065 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:36.343449 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.343476 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.345074 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.345079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.346705 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.346717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.348085 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.348092 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.348266 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.348944 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:36.348988 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:36.350505 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:36.359820 (+ 9315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.359826 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.359830 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.360368 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.361240 (+ 872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.361246 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.361250 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.361409 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.362578 (+ 1169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:36.362587 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:36.362776 (+ 189us) client_negotiation.cc:769] Sending connection context
0807 10:43:36.362941 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 10:43:36.363250 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12073,"thread_start_us":10036,"threads_started":1}
I20260807 10:43:36.364594 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.329980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45640 (local address 127.11.46.188:41877)
0807 10:43:36.330279 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.330288 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.341890 (+ 11602us) server_negotiation.cc:407] Connection header received
0807 10:43:36.342051 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.342057 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.342134 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.342196 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:36.343622 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.344790 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.346841 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.347695 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.347818 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.350701 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:36.350707 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:36.350711 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:36.350747 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:36.358063 (+ 7316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.360541 (+ 2478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.360547 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.360550 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.360712 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.361868 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.361874 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.361877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.362267 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:36.362444 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.364075 (+ 1631us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.364309 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
Aug 07 10:43:36 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.129@KRBTEST.COM
Aug 07 10:43:36 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099412, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.190@KRBTEST.COM for oryx/127.11.46.188@KRBTEST.COM
I20260807 10:43:36.381393 21836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.353793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53850 (local address 127.11.46.129:43459)
0807 10:43:36.354659 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.354667 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.354754 (+ 87us) server_negotiation.cc:407] Connection header received
0807 10:43:36.354837 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.354847 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.355442 (+ 595us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.358254 (+ 2812us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:36.358589 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.360284 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.363114 (+ 2830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.364447 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.364609 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.371002 (+ 6393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:36.371028 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:36.371053 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:36.371110 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:36.375687 (+ 4577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.376817 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.376828 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.376831 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.377039 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.377984 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.377991 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.377994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.378515 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:36.380411 (+ 1896us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.380621 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.380937 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":669,"threads_started":1}
I20260807 10:43:36.383335 21042 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:36.384092 21794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.358434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:41877 (local address 127.0.0.1:45656)
0807 10:43:36.358878 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:36.358899 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:36.359003 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:36.367215 (+ 8212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:36.367222 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:36.367769 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:36.368023 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.368040 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.369883 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.369890 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.371281 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.371304 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.372598 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.372604 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.372799 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.373416 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:36.373485 (+ 69us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:36.376326 (+ 2841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:36.380876 (+ 4550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.380882 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.380886 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.381528 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.382072 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.382077 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.382081 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.382253 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.383025 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:36.383031 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:36.383208 (+ 177us) client_negotiation.cc:769] Sending connection context
0807 10:43:36.383345 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 10:43:36.383687 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309}
I20260807 10:43:36.384106 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.359217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45656 (local address 127.11.46.188:41877)
0807 10:43:36.366729 (+ 7512us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.366736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.366756 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:43:36.366860 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.366866 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.366971 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.368203 (+ 1232us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:36.368411 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.369686 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.371530 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.372352 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.373164 (+ 812us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.376693 (+ 3529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:36.376700 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:36.376705 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:36.376809 (+ 104us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:36.380671 (+ 3862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.381737 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.381742 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.381745 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.381925 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.382437 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.382442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.382444 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.382884 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:36.383038 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.383492 (+ 454us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.383734 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7397,"thread_start_us":22535,"threads_started":1}
I20260807 10:43:36.385780 20779 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.46.188:41877: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a"
member_type: NON_VOTER
last_known_addr {
host: "127.11.46.188"
port: 41877
}
attrs {
promote: true
}
}
dest_uuid: "b8a1d75033ee46cbae07cad9064b6be1"
cas_config_opid_index: 5
I20260807 10:43:36.386761 20779 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } }
I20260807 10:43:36.388716 21790 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 051db34e187143b5bd6d02ddb1bf6f4a (127.11.46.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.390602 21635 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 LEARNER]: Refusing update from remote peer b8a1d75033ee46cbae07cad9064b6be1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 10:43:36.397826 21761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:36.403227 21761 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Refusing update from remote peer b8a1d75033ee46cbae07cad9064b6be1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 10:43:36.416740 21844 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 10:43:36.431388 21790 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.46.188:41877
I20260807 10:43:36.432596 21582 master.cc:537] Master@127.11.46.188:41877 shutting down...
I20260807 10:43:36.432622 21844 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:36.436576 21810 raft_consensus.cc:482] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:43:36.436935 21810 raft_consensus.cc:504] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } }
I20260807 10:43:36.439049 21810 leader_election.cc:288] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8a1d75033ee46cbae07cad9064b6be1 (127.11.46.190:44715), 47dafdcdc8314ab1bf7eb00498241cc0 (127.11.46.189:34107)
W20260807 10:43:36.439496 21727 tablet.cc:2369] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:36.438340 21635 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 051db34e187143b5bd6d02ddb1bf6f4a (127.11.46.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.440513 20791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8a1d75033ee46cbae07cad9064b6be1" is_pre_election: true
I20260807 10:43:36.440706 21634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" is_pre_election: true
I20260807 10:43:36.441857 21717 leader_election.cc:302] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 051db34e187143b5bd6d02ddb1bf6f4a; no voters: 47dafdcdc8314ab1bf7eb00498241cc0, b8a1d75033ee46cbae07cad9064b6be1
I20260807 10:43:36.442687 21810 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 10:43:36.449826 21674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.450182 21674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: This master's current role is: LEARNER
I20260807 10:43:36.449091 21842 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: NON_VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: true } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.450505 21842 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:36.450850 21790 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1: attempting to promote NON_VOTER 47dafdcdc8314ab1bf7eb00498241cc0 to VOTER
I20260807 10:43:36.451946 21790 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } }
I20260807 10:43:36.455181 21635 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 LEARNER]: Refusing update from remote peer b8a1d75033ee46cbae07cad9064b6be1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 10:43:36.455835 21790 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260807 10:43:36.456434 20758 consensus_peers.cc:487] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 -> Peer 051db34e187143b5bd6d02ddb1bf6f4a (127.11.46.188:41877): Couldn't send request to peer 051db34e187143b5bd6d02ddb1bf6f4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 10:43:36.458703 21841 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 47dafdcdc8314ab1bf7eb00498241cc0 (127.11.46.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.459594 21634 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 47dafdcdc8314ab1bf7eb00498241cc0 (127.11.46.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.463303 21844 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.463631 21844 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:36.463928 21844 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.464159 21844 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:36.464491 21674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.464771 21674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:43:36.476018 21582 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:36.476567 21582 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:36.476811 21582 tablet_replica.cc:330] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: stopping tablet replica
I20260807 10:43:36.485108 21582 master.cc:552] Master@127.11.46.188:41877 shutdown complete.
I20260807 10:43:36.485227 21582 master_runner.cc:305] Clearing existing system tablet
I20260807 10:43:36.485846 21582 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:36.486099 21582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:36.489367 21582 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 10:43:36.491299 21855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:36.491688 21582 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:36.492163 21582 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260807 10:43:36.492317 21582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal
uuid: "051db34e187143b5bd6d02ddb1bf6f4a"
format_stamp: "Formatted at 2026-08-07 10:43:36 on dist-test-slave-42z9"
server_key: "549cf48b3af4e32ff70054838c2be06a"
server_key_iv: "40f1c5ba57d6ab9e1a17726b59f8ffa4"
server_key_version: "encryptionkey@0"
I20260807 10:43:36.498049 21582 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:36.506165 21582 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 10:43:36.506379 21582 log.cc:1196] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 10:43:36.506902 21582 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Deleting consensus metadata
I20260807 10:43:36.507234 21582 master_runner.cc:315] Copying system tablet from 127.11.46.190:44715
I20260807 10:43:36.513321 21582 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: tablet copy: Beginning tablet copy session from remote peer at address 127.11.46.190:44715
I20260807 10:43:36.530416 21864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.514332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:54118)
0807 10:43:36.514963 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:36.514988 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:36.515152 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:36.515564 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:36.515569 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:36.516146 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:36.516419 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.516432 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.518015 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.518021 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.519652 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.519677 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.520827 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.520833 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.521014 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.521824 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:36.521852 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:36.522965 (+ 1113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:36.527174 (+ 4209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.527180 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.527184 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.527728 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.528200 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:36.528205 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:36.528209 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:36.528414 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:36.529143 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:36.529149 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:36.529369 (+ 220us) client_negotiation.cc:769] Sending connection context
0807 10:43:36.529595 (+ 226us) client_negotiation.cc:240] Negotiation successful
0807 10:43:36.529949 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":344,"threads_started":1}
I20260807 10:43:36.530457 21807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.514314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54118 (local address 127.11.46.190:44715)
0807 10:43:36.514555 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.514561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.515105 (+ 544us) server_negotiation.cc:407] Connection header received
0807 10:43:36.515291 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.515297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.515388 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.515502 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:36.516606 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.517821 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.519894 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.520645 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.520798 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.523217 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:36.523226 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:36.523231 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:36.523278 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:36.526994 (+ 3716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.527866 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.527872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.527876 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.528054 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:36.528537 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:36.528542 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:36.528546 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:36.528987 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:36.529176 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.529733 (+ 557us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.529992 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260807 10:43:36.531414 20807 tablet_copy_service.cc:140] P b8a1d75033ee46cbae07cad9064b6be1: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 051db34e187143b5bd6d02ddb1bf6f4a ({username='oryx', principal='oryx/127.11.46.188@KRBTEST.COM'} at 127.0.0.1:54118)
I20260807 10:43:36.531610 20807 tablet_copy_service.cc:161] P b8a1d75033ee46cbae07cad9064b6be1: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 051db34e187143b5bd6d02ddb1bf6f4a at {username='oryx', principal='oryx/127.11.46.188@KRBTEST.COM'} at 127.0.0.1:54118: session id = 051db34e187143b5bd6d02ddb1bf6f4a-00000000000000000000000000000000
I20260807 10:43:36.535429 20807 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 10:43:36.537863 21582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 10:43:36.545321 21582 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: tablet copy: Starting download of 0 data blocks...
I20260807 10:43:36.545722 21582 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: tablet copy: Starting download of 1 WAL segments...
I20260807 10:43:36.548684 21582 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 10:43:36.553810 20807 tablet_copy_service.cc:342] P b8a1d75033ee46cbae07cad9064b6be1: Request end of tablet copy session 051db34e187143b5bd6d02ddb1bf6f4a-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.46.188@KRBTEST.COM'} at 127.0.0.1:54118
I20260807 10:43:36.553990 20807 tablet_copy_service.cc:433] P b8a1d75033ee46cbae07cad9064b6be1: ending tablet copy session 051db34e187143b5bd6d02ddb1bf6f4a-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 051db34e187143b5bd6d02ddb1bf6f4a
I20260807 10:43:36.555117 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 20869
I20260807 10:43:36.569708 21582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:36.575284 21865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:36.576845 21866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:36.583736 21873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:36.584746 21582 server_base.cc:1034] running on GCE node
I20260807 10:43:36.585223 21582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:36.586170 21582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:36.587481 21582 hybrid_clock.cc:648] HybridClock initialized: now 1786099416587417 us; error 50 us; skew 500 ppm
I20260807 10:43:36.587754 21582 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:36 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:36.590113 21582 init.cc:377] Logged in from keytab as oryx/127.11.46.188@KRBTEST.COM (short username oryx)
I20260807 10:43:36.595134 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:43459
--local_ip_for_outbound_sockets=127.11.46.129
--tserver_master_addrs=127.11.46.190:44715
--webserver_port=44219
--webserver_interface=127.11.46.129
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab
--principal=oryx/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.46.190:44715,127.11.46.189:34107
--tserver_master_addrs=127.11.46.190:44715,127.11.46.189:34107,127.11.46.188:41877 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:43:36.596205 21582 webserver.cc:460] Webserver started at http://127.11.46.188:37339/ using document root <none> and password file <none>
I20260807 10:43:36.596612 21582 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:36.596720 21582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:36.602324 21582 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260807 10:43:36.605927 21888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:36.606437 21582 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 10:43:36.606658 21582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal
uuid: "051db34e187143b5bd6d02ddb1bf6f4a"
format_stamp: "Formatted at 2026-08-07 10:43:36 on dist-test-slave-42z9"
server_key: "549cf48b3af4e32ff70054838c2be06a"
server_key_iv: "40f1c5ba57d6ab9e1a17726b59f8ffa4"
server_key_version: "encryptionkey@0"
I20260807 10:43:36.606940 21582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:36.620687 21582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:36.625566 21582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:36.672012 21582 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.188:41877
I20260807 10:43:36.672093 21956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.188:41877 every 8 connection(s)
I20260807 10:43:36.673373 21582 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
I20260807 10:43:36.679318 21957 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:43:36.683851 21957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Bootstrap starting.
I20260807 10:43:36.707633 21957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:43:36.708288 21957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Bootstrap complete.
I20260807 10:43:36.709745 21957 raft_consensus.cc:348] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } }
I20260807 10:43:36.710137 21957 raft_consensus.cc:729] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 051db34e187143b5bd6d02ddb1bf6f4a, State: Initialized, Role: LEARNER
I20260807 10:43:36.710508 21957 consensus_queue.cc:260] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } }
I20260807 10:43:36.711426 21961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.711978 21961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: This master's current role is: LEARNER
I20260807 10:43:36.712198 21957 sys_catalog.cc:564] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:36.724130 21975 catalog_manager.cc:1259] Loaded cluster ID: efd4533c4e5b4b63888aa197d1f36848
I20260807 10:43:36.724342 21975 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: loading cluster ID for follower catalog manager: success
I20260807 10:43:36.727205 21975 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: acquiring CA information for follower catalog manager: success
I20260807 10:43:36.729257 21975 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:43:36.838908 21794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.830442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:41877 (local address 127.0.0.1:45672)
0807 10:43:36.830750 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:36.830771 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:36.830913 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:36.832123 (+ 1210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:36.832129 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:36.832165 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:36.832367 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.832380 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.834344 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.834350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.836311 (+ 1961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:36.836338 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.838002 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.838009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:36.838230 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.838268 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 10:43:36.838378 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 10:43:36.838559 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260807 10:43:36.838943 21977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:36.830707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45672 (local address 127.11.46.188:41877)
0807 10:43:36.831628 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:36.831635 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:36.831668 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:43:36.831757 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:36.831762 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:36.831860 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:36.832028 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:36.832571 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.834147 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.836557 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:36.837790 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:36.837925 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:36.838199 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:36.838413 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 10:43:36.838558 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":536,"threads_started":1}
I20260807 10:43:36.840442 21922 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 10:43:36.841116 21961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8a1d75033ee46cbae07cad9064b6be1. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:36.841434 21961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: This master's current role is: LEARNER
W20260807 10:43:37.058049 21890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:37.058436 21890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:37.058599 21890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:37.066757 21890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:37.066926 21890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:37.067090 21890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:37.077833 21890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab
--principal=oryx/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:43459
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=44219
--tserver_master_addrs=127.11.46.190:44715,127.11.46.189:34107,127.11.46.188:41877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:37.079434 21890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:37.080942 21890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:37.096256 21985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:37.096312 21987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:37.096230 21984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:37.097221 21890 server_base.cc:1034] running on GCE node
I20260807 10:43:37.098048 21890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:37.099195 21890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:37.100433 21890 hybrid_clock.cc:648] HybridClock initialized: now 1786099417100356 us; error 70 us; skew 500 ppm
I20260807 10:43:37.100801 21890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:37 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:37.104553 21890 init.cc:377] Logged in from keytab as oryx/127.11.46.129@KRBTEST.COM (short username oryx)
I20260807 10:43:37.106413 21890 webserver.cc:460] Webserver started at http://127.11.46.129:44219/ using document root <none> and password file <none>
I20260807 10:43:37.107223 21890 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:37.107393 21890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:37.113902 21890 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:37.117252 21995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:37.119118 21890 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:37.119426 21890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "4f6e57e82faa41e78d7f61ada26f5379"
format_stamp: "Formatted at 2026-08-07 10:43:33 on dist-test-slave-42z9"
server_key: "69f7379f27904cc7a6cb4b8b13ad4f74"
server_key_iv: "6a6718ee9d8677ed03089a7fb945887e"
server_key_version: "encryptionkey@0"
I20260807 10:43:37.120594 21890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:37.139366 21890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:37.144480 21890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:37.144778 21890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:37.145908 21890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:37.147594 21890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:37.147706 21890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:37.147806 21890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:37.147872 21890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:37.189304 21890 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:43459
I20260807 10:43:37.189364 22152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:43459 every 8 connection(s)
I20260807 10:43:37.191061 21890 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:37.198948 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 21890
I20260807 10:43:37.199333 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 21060
Aug 07 10:43:37 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
Aug 07 10:43:37 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.188@KRBTEST.COM
Aug 07 10:43:37 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.189@KRBTEST.COM
I20260807 10:43:37.223515 21977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.194612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:39781 (local address 127.11.46.188:41877)
0807 10:43:37.194827 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:37.194833 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:37.196593 (+ 1760us) server_negotiation.cc:407] Connection header received
0807 10:43:37.199286 (+ 2693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:37.199291 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:37.199393 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:37.199482 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:37.202508 (+ 3026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.203706 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.207193 (+ 3487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.207902 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.208022 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.214112 (+ 6090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:37.214120 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:37.214125 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:37.214174 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:37.218350 (+ 4176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.219780 (+ 1430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.219788 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.219791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.220013 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.220683 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.220690 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.220693 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.221122 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:37.221658 (+ 536us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:37.222874 (+ 1216us) server_negotiation.cc:299] Negotiation successful
0807 10:43:37.223169 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:43:37.224678 22163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.197196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:40955 (local address 127.11.46.190:44715)
0807 10:43:37.197692 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:37.197698 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:37.198195 (+ 497us) server_negotiation.cc:407] Connection header received
0807 10:43:37.199281 (+ 1086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:37.199287 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:37.199392 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:37.199498 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:37.202548 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.204008 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.207202 (+ 3194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.208054 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.208186 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.215577 (+ 7391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:37.215586 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:37.215591 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:37.215690 (+ 99us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:37.219490 (+ 3800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.220692 (+ 1202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.220698 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.220701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.220898 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.221388 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.221393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.221395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.221820 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:37.221963 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:37.224018 (+ 2055us) server_negotiation.cc:299] Negotiation successful
0807 10:43:37.224265 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":258,"threads_started":1}
I20260807 10:43:37.224869 22160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.194743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:33441 (local address 127.11.46.189:34107)
0807 10:43:37.195239 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:37.195245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:37.196587 (+ 1342us) server_negotiation.cc:407] Connection header received
0807 10:43:37.199192 (+ 2605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:37.199199 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:37.199304 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:37.199410 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:37.202509 (+ 3099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.203706 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.207193 (+ 3487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.207902 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.208022 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.217690 (+ 9668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:37.217698 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:37.217703 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:37.217750 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:37.221489 (+ 3739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.222336 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.222343 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.222347 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.222557 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.223072 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.223077 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.223080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.223535 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:37.223674 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:37.224211 (+ 537us) server_negotiation.cc:299] Negotiation successful
0807 10:43:37.224482 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":249,"threads_started":1}
I20260807 10:43:37.225726 22162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.195377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:41877 (local address 127.11.46.129:39781)
0807 10:43:37.196411 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:37.196456 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:37.198853 (+ 2397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:37.199947 (+ 1094us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:37.199952 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:37.200951 (+ 999us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:37.202263 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.202294 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.203956 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.203960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.206985 (+ 3025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.206997 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.208514 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.208524 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.209598 (+ 1074us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.211264 (+ 1666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:37.211284 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:37.213770 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:37.218609 (+ 4839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.218622 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.218647 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.219628 (+ 981us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.220193 (+ 565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.220198 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.220201 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.220536 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.221785 (+ 1249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:37.221794 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:37.222343 (+ 549us) client_negotiation.cc:769] Sending connection context
0807 10:43:37.223822 (+ 1479us) client_negotiation.cc:240] Negotiation successful
0807 10:43:37.224149 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"mutex_wait_us":1208,"spinlock_wait_cycles":71680,"thread_start_us":418,"threads_started":1}
I20260807 10:43:37.226074 22161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.195377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:34107 (local address 127.11.46.129:33441)
0807 10:43:37.196403 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:37.196456 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:37.198853 (+ 2397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:37.199938 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:37.199951 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:37.200952 (+ 1001us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:37.202263 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.202294 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.203951 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.203957 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.206975 (+ 3018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.206997 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.208514 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.208524 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.212382 (+ 3858us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.213645 (+ 1263us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:37.213669 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:37.216934 (+ 3265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:37.221666 (+ 4732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.221671 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.221674 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.222181 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.222731 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.222736 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.222740 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.222924 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.223761 (+ 837us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:37.223765 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:37.223925 (+ 160us) client_negotiation.cc:769] Sending connection context
0807 10:43:37.225077 (+ 1152us) client_negotiation.cc:240] Negotiation successful
0807 10:43:37.225458 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"mutex_wait_us":783,"spinlock_wait_cycles":15872,"thread_start_us":384,"threads_started":1}
I20260807 10:43:37.226354 22164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.197190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.129:40955)
0807 10:43:37.198095 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:37.198110 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:37.198870 (+ 760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:37.199940 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:37.199951 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:37.201631 (+ 1680us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:37.202319 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.202337 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.204219 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.204226 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.206984 (+ 2758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.207006 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.208596 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.208603 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.208931 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.210017 (+ 1086us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:37.210045 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:37.215255 (+ 5210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:37.219905 (+ 4650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.219910 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.219914 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.220543 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.221047 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.221052 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.221055 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.221251 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.222023 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:37.222027 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:37.222344 (+ 317us) client_negotiation.cc:769] Sending connection context
0807 10:43:37.222722 (+ 378us) client_negotiation.cc:240] Negotiation successful
0807 10:43:37.223329 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":776,"mutex_wait_us":193,"spinlock_wait_cycles":9600,"thread_start_us":612,"threads_started":1}
I20260807 10:43:37.227603 22158 heartbeater.cc:347] Connected to a master server at 127.11.46.189:34107
I20260807 10:43:37.227974 22158 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:37.228351 22157 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44715
I20260807 10:43:37.228406 22154 heartbeater.cc:347] Connected to a master server at 127.11.46.188:41877
I20260807 10:43:37.228525 22157 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:37.228528 22154 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:37.229269 22154 heartbeater.cc:511] Master 127.11.46.188:41877 requested a full tablet report, sending...
I20260807 10:43:37.229291 22157 heartbeater.cc:511] Master 127.11.46.190:44715 requested a full tablet report, sending...
I20260807 10:43:37.229645 22158 heartbeater.cc:511] Master 127.11.46.189:34107 requested a full tablet report, sending...
Aug 07 10:43:37 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.130@KRBTEST.COM
I20260807 10:43:37.231688 20779 ts_manager.cc:194] Re-registered known tserver with Master: 4f6e57e82faa41e78d7f61ada26f5379 (127.11.46.129:43459)
I20260807 10:43:37.232767 20779 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:40955
I20260807 10:43:37.234558 21622 ts_manager.cc:194] Registered new tserver with Master: 4f6e57e82faa41e78d7f61ada26f5379 (127.11.46.129:43459)
I20260807 10:43:37.234586 21908 ts_manager.cc:194] Registered new tserver with Master: 4f6e57e82faa41e78d7f61ada26f5379 (127.11.46.129:43459)
I20260807 10:43:37.239801 22166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.200803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38394 (local address 127.11.46.130:44463)
0807 10:43:37.213627 (+ 12824us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:37.213637 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:37.213675 (+ 38us) server_negotiation.cc:407] Connection header received
0807 10:43:37.213764 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:37.213774 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:37.214071 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:37.214264 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:37.216274 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.217935 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.220155 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.221187 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.221336 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.232607 (+ 11271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:37.232627 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:37.232642 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:37.232690 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:37.236769 (+ 4079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.237676 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.237684 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.237686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.237859 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.238185 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.238189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.238191 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.238605 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:37.238858 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:37.239098 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 10:43:37.239365 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12559,"thread_start_us":13678,"threads_started":1}
I20260807 10:43:37.241341 21238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:37.329221 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 21060
I20260807 10:43:37.356141 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:44463
--local_ip_for_outbound_sockets=127.11.46.130
--tserver_master_addrs=127.11.46.190:44715
--webserver_port=37117
--webserver_interface=127.11.46.130
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab
--principal=oryx/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.46.190:44715,127.11.46.189:34107
--tserver_master_addrs=127.11.46.190:44715,127.11.46.189:34107,127.11.46.188:41877 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:43:37.450577 21841 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: NON_VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: true } } }
I20260807 10:43:37.450999 21841 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:37.453630 22171 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1: attempting to promote NON_VOTER 051db34e187143b5bd6d02ddb1bf6f4a to VOTER
I20260807 10:43:37.454443 22171 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } }
I20260807 10:43:37.456766 21922 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 LEARNER]: Refusing update from remote peer b8a1d75033ee46cbae07cad9064b6be1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 10:43:37.456840 21634 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 FOLLOWER]: Refusing update from remote peer b8a1d75033ee46cbae07cad9064b6be1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 10:43:37.457547 22169 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 10:43:37.458038 21841 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 10:43:37.461341 22169 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 051db34e187143b5bd6d02ddb1bf6f4a (127.11.46.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:37.462317 21634 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 051db34e187143b5bd6d02ddb1bf6f4a (127.11.46.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:37.465636 22169 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:37.465971 22169 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:37.466306 22169 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:37.466542 22169 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:37.471562 22175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:37.472033 22175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:43:37.472398 22169 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:37.472661 22169 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:37.473326 21922 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 051db34e187143b5bd6d02ddb1bf6f4a (127.11.46.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:37.477351 22176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b8a1d75033ee46cbae07cad9064b6be1" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:37.477761 22176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: This master's current role is: FOLLOWER
W20260807 10:43:37.756493 22168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:37.756850 22168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:37.756995 22168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:37.764907 22168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:37.765060 22168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:37.765219 22168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:37.776062 22168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab
--principal=oryx/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:44463
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=37117
--tserver_master_addrs=127.11.46.190:44715,127.11.46.189:34107,127.11.46.188:41877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:37.777608 22168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:37.779100 22168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:37.793624 22182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:37.794180 22185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:37.794255 22183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:37.795112 22168 server_base.cc:1034] running on GCE node
I20260807 10:43:37.795830 22168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:37.796994 22168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:37.798218 22168 hybrid_clock.cc:648] HybridClock initialized: now 1786099417798151 us; error 61 us; skew 500 ppm
I20260807 10:43:37.798601 22168 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:37 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:37.802217 22168 init.cc:377] Logged in from keytab as oryx/127.11.46.130@KRBTEST.COM (short username oryx)
I20260807 10:43:37.803980 22168 webserver.cc:460] Webserver started at http://127.11.46.130:37117/ using document root <none> and password file <none>
I20260807 10:43:37.804837 22168 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:37.804980 22168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:37.812824 22168 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 10:43:37.816591 22195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:37.818392 22168 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:37.818601 22168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "fa4365b17c51407ea3622f273f296f69"
format_stamp: "Formatted at 2026-08-07 10:43:34 on dist-test-slave-42z9"
server_key: "07b223dc7ee83616fa3574020869e9d9"
server_key_iv: "590ff08a1175ad7d0eeee9187a6802a0"
server_key_version: "encryptionkey@0"
I20260807 10:43:37.819912 22168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:37.839890 22168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:37.844779 22168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:37.845096 22168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:37.846288 22168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:37.848050 22168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:37.848161 22168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:37.848284 22168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:37.848362 22168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:37.885185 22168 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:44463
I20260807 10:43:37.885229 22344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:44463 every 8 connection(s)
I20260807 10:43:37.886945 22168 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:37.888813 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 22168
I20260807 10:43:37.889132 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 21250
Aug 07 10:43:37 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.131@KRBTEST.COM
Aug 07 10:43:37 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.188@KRBTEST.COM
Aug 07 10:43:37 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.189@KRBTEST.COM
I20260807 10:43:37.918147 22354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.892122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47544 (local address 127.11.46.131:37093)
0807 10:43:37.892695 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:37.892705 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:37.892739 (+ 34us) server_negotiation.cc:407] Connection header received
0807 10:43:37.892823 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:37.892830 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:37.893144 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:37.893356 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:37.896955 (+ 3599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.898831 (+ 1876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.901077 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.902145 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.902270 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.909526 (+ 7256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:37.909554 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:37.909576 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:37.909629 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:37.913459 (+ 3830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.914976 (+ 1517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.914988 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.914991 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.915175 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.915689 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.915694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.915697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.916213 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:37.916517 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:37.917253 (+ 736us) server_negotiation.cc:299] Negotiation successful
0807 10:43:37.917631 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":544,"threads_started":1}
I20260807 10:43:37.921042 21426 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:37.921958 22355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.892497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:38621 (local address 127.11.46.188:41877)
0807 10:43:37.894115 (+ 1618us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:37.894121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:37.895683 (+ 1562us) server_negotiation.cc:407] Connection header received
0807 10:43:37.899147 (+ 3464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:37.899154 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:37.899258 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:37.899371 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:37.902432 (+ 3061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.903702 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.906839 (+ 3137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.907509 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.907613 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.913555 (+ 5942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:37.913563 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:37.913567 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:37.913633 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:37.917565 (+ 3932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.918849 (+ 1284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.918855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.918859 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.919043 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.919674 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.919680 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.919683 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.920091 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:37.920263 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:37.921226 (+ 963us) server_negotiation.cc:299] Negotiation successful
0807 10:43:37.921543 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1477,"thread_start_us":1350,"threads_started":1}
I20260807 10:43:37.924908 22356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.891075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:41877 (local address 127.11.46.130:38621)
0807 10:43:37.895481 (+ 4406us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:37.895535 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:37.898650 (+ 3115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:37.900110 (+ 1460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:37.900127 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:37.901104 (+ 977us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:37.902162 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.902193 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.903959 (+ 1766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.903965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.906634 (+ 2669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.906653 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.908072 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.908080 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.908405 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.909679 (+ 1274us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:37.909713 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:37.913166 (+ 3453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:37.917742 (+ 4576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.917752 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.917770 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.918691 (+ 921us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.919198 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.919203 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.919207 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.919519 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.920251 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:37.920259 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:37.920725 (+ 466us) client_negotiation.cc:769] Sending connection context
0807 10:43:37.922584 (+ 1859us) client_negotiation.cc:240] Negotiation successful
0807 10:43:37.923299 (+ 715us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4070,"thread_start_us":7832,"threads_started":1}
Aug 07 10:43:37 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:37.927140 22351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.890326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:49091 (local address 127.11.46.189:34107)
0807 10:43:37.903915 (+ 13589us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:37.903922 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:37.903943 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:43:37.904015 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:37.904020 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:37.904100 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:37.905744 (+ 1644us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:37.905918 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.907363 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.910329 (+ 2966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.911021 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.911168 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.917188 (+ 6020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:37.917196 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:37.917201 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:37.917245 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:37.922294 (+ 5049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.923532 (+ 1238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.923539 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.923543 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.923798 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.924407 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.924413 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.924417 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.924921 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:37.925109 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:37.926479 (+ 1370us) server_negotiation.cc:299] Negotiation successful
0807 10:43:37.926737 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13450,"thread_start_us":13880,"threads_started":1}
I20260807 10:43:37.927524 22353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.893077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:34107 (local address 127.11.46.130:49091)
0807 10:43:37.900067 (+ 6990us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:37.900090 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:37.900213 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:37.904423 (+ 4210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:37.904428 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:37.905167 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:37.905564 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.905578 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.907559 (+ 1981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.907565 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.910113 (+ 2548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.910133 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.911465 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.911473 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.911678 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.913528 (+ 1850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:37.913555 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:37.916918 (+ 3363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:37.922516 (+ 5598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.922522 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.922527 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.923350 (+ 823us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.924072 (+ 722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.924077 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.924081 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.924261 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.925223 (+ 962us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:37.925229 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:37.925456 (+ 227us) client_negotiation.cc:769] Sending connection context
0807 10:43:37.925611 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 10:43:37.925987 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6173,"thread_start_us":1957,"threads_started":1}
I20260807 10:43:37.928504 22345 heartbeater.cc:347] Connected to a master server at 127.11.46.188:41877
I20260807 10:43:37.928807 22345 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:37.929890 22345 heartbeater.cc:511] Master 127.11.46.188:41877 requested a full tablet report, sending...
I20260807 10:43:37.930735 22347 heartbeater.cc:347] Connected to a master server at 127.11.46.189:34107
I20260807 10:43:37.930917 22347 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:37.931313 22347 heartbeater.cc:511] Master 127.11.46.189:34107 requested a full tablet report, sending...
I20260807 10:43:37.932607 21908 ts_manager.cc:194] Registered new tserver with Master: fa4365b17c51407ea3622f273f296f69 (127.11.46.130:44463)
I20260807 10:43:37.932679 21622 ts_manager.cc:194] Registered new tserver with Master: fa4365b17c51407ea3622f273f296f69 (127.11.46.130:44463)
I20260807 10:43:37.935180 22357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.899901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:42577 (local address 127.11.46.190:44715)
0807 10:43:37.909521 (+ 9620us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:37.909528 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:37.915605 (+ 6077us) server_negotiation.cc:407] Connection header received
0807 10:43:37.915712 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:37.915717 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:37.915836 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:37.915953 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:37.917309 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.918513 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.920337 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.920975 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.921115 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.928007 (+ 6892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:37.928015 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:37.928020 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:37.928078 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:37.931380 (+ 3302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.933009 (+ 1629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.933014 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.933018 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.933192 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:37.933736 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:37.933742 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:37.933745 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:37.934046 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:37.934187 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:37.934596 (+ 409us) server_negotiation.cc:299] Negotiation successful
0807 10:43:37.934823 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9436,"thread_start_us":9305,"threads_started":1}
I20260807 10:43:37.935194 22358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:37.903029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.130:42577)
0807 10:43:37.915334 (+ 12305us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:37.915356 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:37.915492 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:37.916014 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:37.916018 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:37.916701 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:37.917113 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.917128 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.918691 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.918697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.920152 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:37.920166 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:37.921370 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:37.921377 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:37.921595 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:37.922174 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:37.922197 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:37.927699 (+ 5502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:37.931527 (+ 3828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.931534 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.931538 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.932058 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.933331 (+ 1273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:37.933336 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:37.933340 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:37.933599 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:37.934168 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:37.934173 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:37.934324 (+ 151us) client_negotiation.cc:769] Sending connection context
0807 10:43:37.934440 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 10:43:37.934759 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12172,"thread_start_us":11977,"threads_started":1}
I20260807 10:43:37.936067 22346 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44715
I20260807 10:43:37.936224 22346 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:37.936729 22346 heartbeater.cc:511] Master 127.11.46.190:44715 requested a full tablet report, sending...
I20260807 10:43:37.937884 20779 ts_manager.cc:194] Re-registered known tserver with Master: fa4365b17c51407ea3622f273f296f69 (127.11.46.130:44463)
I20260807 10:43:37.939044 20779 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:42577
I20260807 10:43:38.015671 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 21250
I20260807 10:43:38.045508 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:37093
--local_ip_for_outbound_sockets=127.11.46.131
--tserver_master_addrs=127.11.46.190:44715
--webserver_port=39835
--webserver_interface=127.11.46.131
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab
--principal=oryx/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.46.190:44715,127.11.46.189:34107
--tserver_master_addrs=127.11.46.190:44715,127.11.46.189:34107,127.11.46.188:41877 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:43:38.237591 22157 heartbeater.cc:503] Master 127.11.46.190:44715 was elected leader, sending a full tablet report...
W20260807 10:43:38.424819 22360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:38.425184 22360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:38.425338 22360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:38.433593 22360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:38.433750 22360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:38.433904 22360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:38.444543 22360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab
--principal=oryx/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:37093
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=39835
--tserver_master_addrs=127.11.46.190:44715,127.11.46.189:34107,127.11.46.188:41877
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:38.446125 22360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:38.447542 22360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:38.461760 22367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:38.461814 22368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:38.461742 22370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:38.463138 22360 server_base.cc:1034] running on GCE node
I20260807 10:43:38.463886 22360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:38.465055 22360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:38.466282 22360 hybrid_clock.cc:648] HybridClock initialized: now 1786099418466231 us; error 52 us; skew 500 ppm
I20260807 10:43:38.466643 22360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:38 dist-test-slave-42z9 krb5kdc[20718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099418, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:38.470024 22360 init.cc:377] Logged in from keytab as oryx/127.11.46.131@KRBTEST.COM (short username oryx)
I20260807 10:43:38.471622 22360 webserver.cc:460] Webserver started at http://127.11.46.131:39835/ using document root <none> and password file <none>
I20260807 10:43:38.472396 22360 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:38.472558 22360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:38.478865 22360 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:43:38.482125 22379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:38.483625 22360 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:43:38.483824 22360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "98b4a5b95b0a46d986cdc9cdf8af590d"
format_stamp: "Formatted at 2026-08-07 10:43:34 on dist-test-slave-42z9"
server_key: "4fd3515e5b93012c627744d3d1f9af19"
server_key_iv: "5ebaf7d395d005aec6f2bccd4d85db79"
server_key_version: "encryptionkey@0"
I20260807 10:43:38.484937 22360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:38.505349 22360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:38.510113 22360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:38.510406 22360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:38.511471 22360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:38.512997 22360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:38.513094 22360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:38.513208 22360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:38.513289 22360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:38.544339 22360 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:37093
I20260807 10:43:38.544397 22551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:37093 every 8 connection(s)
I20260807 10:43:38.546011 22360 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:38.546582 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 22360
Aug 07 10:43:38 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099418, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.189@KRBTEST.COM
Aug 07 10:43:38 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099418, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.188@KRBTEST.COM
Aug 07 10:43:38 dist-test-slave-42z9 krb5kdc[20718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099418, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:38.596395 22565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.550709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:34107 (local address 127.11.46.131:33083)
0807 10:43:38.563118 (+ 12409us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:38.563146 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:38.563330 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:38.564825 (+ 1495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:38.564831 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:38.565860 (+ 1029us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:38.569687 (+ 3827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.569736 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.571848 (+ 2112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.571855 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.574593 (+ 2738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.574623 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.578002 (+ 3379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.578008 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.578185 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.581643 (+ 3458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:38.581669 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:38.586111 (+ 4442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:38.590682 (+ 4571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:38.590694 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:38.590720 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:38.591488 (+ 768us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:38.592000 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:38.592005 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:38.592009 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:38.592303 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:38.593101 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:38.593110 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:38.593686 (+ 576us) client_negotiation.cc:769] Sending connection context
0807 10:43:38.594116 (+ 430us) client_negotiation.cc:240] Negotiation successful
0807 10:43:38.594766 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12206,"mutex_wait_us":1,"thread_start_us":7668,"threads_started":1}
I20260807 10:43:38.598073 22563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.550272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:33083 (local address 127.11.46.189:34107)
0807 10:43:38.556724 (+ 6452us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.556731 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.563285 (+ 6554us) server_negotiation.cc:407] Connection header received
0807 10:43:38.563439 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.563456 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.563553 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.563670 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:38.570084 (+ 6414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.571547 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.576820 (+ 5273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.577566 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.577712 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.586444 (+ 8732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:38.586452 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:38.586457 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:38.586520 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:38.590449 (+ 3929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.591670 (+ 1221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.591675 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.591678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.591852 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.592466 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.592483 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.592487 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.592873 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:38.593016 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.597280 (+ 4264us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.597631 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6313,"thread_start_us":6150,"threads_started":1}
I20260807 10:43:38.600065 22557 heartbeater.cc:347] Connected to a master server at 127.11.46.189:34107
I20260807 10:43:38.600519 22557 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:38.601729 22557 heartbeater.cc:511] Master 127.11.46.189:34107 requested a full tablet report, sending...
I20260807 10:43:38.602499 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.550423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.131:57367)
0807 10:43:38.559018 (+ 8595us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:38.559113 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:38.562374 (+ 3261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:38.563447 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:38.563460 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:38.570445 (+ 6985us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:38.570779 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.570795 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.572462 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.572469 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.576454 (+ 3985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.576488 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.577802 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.577812 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.578188 (+ 376us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.581616 (+ 3428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:38.581659 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:38.592597 (+ 10938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:38.598010 (+ 5413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:38.598016 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:38.598020 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:38.599447 (+ 1427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:38.600164 (+ 717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:38.600170 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:38.600173 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:38.600399 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:38.601245 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:38.601250 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:38.601489 (+ 239us) client_negotiation.cc:769] Sending connection context
0807 10:43:38.601641 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 10:43:38.602019 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8121,"mutex_wait_us":2412,"thread_start_us":12811,"threads_started":1}
I20260807 10:43:38.602525 22561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.549926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:57367 (local address 127.11.46.190:44715)
0807 10:43:38.556256 (+ 6330us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.556265 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.559292 (+ 3027us) server_negotiation.cc:407] Connection header received
0807 10:43:38.562853 (+ 3561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.562859 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.562981 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.563084 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:38.570989 (+ 7905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.572290 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.576672 (+ 4382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.577368 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.577564 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.592834 (+ 15270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:38.592842 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:38.592846 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:38.592893 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:38.596974 (+ 4081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.599751 (+ 2777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.599757 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.599760 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.599947 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.600552 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.600559 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.600563 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.601103 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:38.601263 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.601877 (+ 614us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.602158 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6124,"thread_start_us":5970,"threads_started":1}
I20260807 10:43:38.603835 22555 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44715
I20260807 10:43:38.603996 22555 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:38.604450 22555 heartbeater.cc:511] Master 127.11.46.190:44715 requested a full tablet report, sending...
I20260807 10:43:38.604440 21622 ts_manager.cc:194] Registered new tserver with Master: 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093)
I20260807 10:43:38.605720 20779 ts_manager.cc:194] Re-registered known tserver with Master: 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093)
I20260807 10:43:38.606890 20779 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:57367
I20260807 10:43:38.614656 22570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.564225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:41877 (local address 127.11.46.131:35657)
0807 10:43:38.577642 (+ 13417us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:38.577666 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:38.577809 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:38.578939 (+ 1130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:38.578944 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:38.579437 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:38.579717 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.579726 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.581131 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.581135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.582680 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.582702 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.583855 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.583862 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.584073 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.584755 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:38.584782 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:38.588295 (+ 3513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:38.609511 (+ 21216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:38.609517 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:38.609521 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:38.610158 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:38.610693 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:38.610699 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:38.610703 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:38.610902 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:38.612793 (+ 1891us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:38.612799 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:38.613004 (+ 205us) client_negotiation.cc:769] Sending connection context
0807 10:43:38.613558 (+ 554us) client_negotiation.cc:240] Negotiation successful
0807 10:43:38.614207 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13248,"thread_start_us":13021,"threads_started":1}
I20260807 10:43:38.617578 22572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.564244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:35657 (local address 127.11.46.188:41877)
0807 10:43:38.578323 (+ 14079us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.578331 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.578352 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:43:38.578421 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.578426 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.578513 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.578628 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:38.579872 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.580939 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.582910 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.583623 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.584621 (+ 998us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.589748 (+ 5127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:38.589764 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:38.589771 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:38.589871 (+ 100us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:38.609191 (+ 19320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.610357 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.610362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.610366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.610540 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.611097 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.611102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.611105 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.611490 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:38.614036 (+ 2546us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.614204 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.614459 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13915,"thread_start_us":13955,"threads_started":1}
I20260807 10:43:38.619215 22552 heartbeater.cc:347] Connected to a master server at 127.11.46.188:41877
I20260807 10:43:38.619454 22552 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:38.620077 22552 heartbeater.cc:511] Master 127.11.46.188:41877 requested a full tablet report, sending...
I20260807 10:43:38.621706 21908 ts_manager.cc:194] Registered new tserver with Master: 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093)
I20260807 10:43:38.624509 22578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.582051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54124 (local address 127.11.46.190:44715)
0807 10:43:38.592635 (+ 10584us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.592642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.598153 (+ 5511us) server_negotiation.cc:407] Connection header received
0807 10:43:38.598230 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.598236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.598334 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.598440 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:38.605770 (+ 7330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.608132 (+ 2362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.611651 (+ 3519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.612358 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.612541 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.616511 (+ 3970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:38.616519 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:38.616524 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:38.616573 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:38.620431 (+ 3858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.621494 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.621500 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.621504 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.621683 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.622184 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.622189 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.622192 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.622620 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:38.622877 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.623506 (+ 629us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.623779 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10410,"thread_start_us":10674,"threads_started":1}
I20260807 10:43:38.627199 22563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.584000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47094 (local address 127.11.46.189:34107)
0807 10:43:38.598923 (+ 14923us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.598929 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.605842 (+ 6913us) server_negotiation.cc:407] Connection header received
0807 10:43:38.606345 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.606350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.606462 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.606539 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:38.611461 (+ 4922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.612568 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.614646 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.615253 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.615335 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.619270 (+ 3935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:38.619278 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:38.619282 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:38.619331 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:38.623111 (+ 3780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.624108 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.624115 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.624118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.624285 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.625156 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.625162 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.625165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.625636 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:38.625925 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.626574 (+ 649us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.626848 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14808,"thread_start_us":16001,"threads_started":1}
I20260807 10:43:38.627490 22581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.591001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45674 (local address 127.11.46.188:41877)
0807 10:43:38.599844 (+ 8843us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.599850 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.606250 (+ 6400us) server_negotiation.cc:407] Connection header received
0807 10:43:38.606330 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.606335 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.606425 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.606539 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:38.609368 (+ 2829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.610663 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.612280 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.612945 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.613086 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.617571 (+ 4485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:38.617579 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:38.617584 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:38.617632 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:38.623448 (+ 5816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.624430 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.624436 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.624440 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.624613 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.625502 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.625508 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.625510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.625862 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:38.626130 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.626814 (+ 684us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.627075 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8691,"thread_start_us":8502,"threads_started":1}
I20260807 10:43:38.629869 20779 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54124:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:43:38.637507 20779 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:43:38.684523 22601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.660669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:43459 (local address 127.0.0.1:53866)
0807 10:43:38.672377 (+ 11708us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:38.672403 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:38.672585 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:38.675321 (+ 2736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:38.675327 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:38.675361 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:38.675765 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.675778 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.678147 (+ 2369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.678154 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.680932 (+ 2778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.680959 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.683625 (+ 2666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.683632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.683844 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.683886 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 10:43:38.684001 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 10:43:38.684154 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11545,"thread_start_us":20818,"threads_started":1}
I20260807 10:43:38.686067 22602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.660971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53866 (local address 127.11.46.129:43459)
0807 10:43:38.674288 (+ 13317us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.674300 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.674337 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:43:38.674482 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.674493 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.674800 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.675055 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:38.676257 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.677948 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.681230 (+ 3282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.683007 (+ 1777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.683170 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.683430 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.685416 (+ 1986us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.685714 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13090,"thread_start_us":14943,"threads_started":1}
I20260807 10:43:38.692332 22063 tablet_service.cc:1467] Processing CreateTablet for tablet 8faae2b7caf94719b5270849d353f4e4 (DEFAULT_TABLE table=test-table [id=f43a314a95b54baeb40d70a1767c4daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:38.693537 22605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.672241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:44463 (local address 127.0.0.1:38406)
0807 10:43:38.684153 (+ 11912us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:38.684175 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:38.684297 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:38.687543 (+ 3246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:38.687548 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:38.687579 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:38.687926 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.687940 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.689719 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.689725 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.691249 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.691267 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.692626 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.692633 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.692818 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.692847 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 10:43:38.692964 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 10:43:38.693086 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11767,"thread_start_us":12138,"threads_started":1}
I20260807 10:43:38.694458 22603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.667586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38406 (local address 127.11.46.130:44463)
0807 10:43:38.686490 (+ 18904us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.686499 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.686534 (+ 35us) server_negotiation.cc:407] Connection header received
0807 10:43:38.686655 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.686664 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.687005 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.687257 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:38.688376 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.689570 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.691435 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.692394 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.692525 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.692757 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.693583 (+ 826us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.694133 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18690,"thread_start_us":20474,"threads_started":1}
I20260807 10:43:38.695117 22063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8faae2b7caf94719b5270849d353f4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:38.698030 22258 tablet_service.cc:1467] Processing CreateTablet for tablet 8faae2b7caf94719b5270849d353f4e4 (DEFAULT_TABLE table=test-table [id=f43a314a95b54baeb40d70a1767c4daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:38.699751 22258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8faae2b7caf94719b5270849d353f4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:38.713616 22599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.659697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:37093 (local address 127.0.0.1:47560)
0807 10:43:38.666995 (+ 7298us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:38.667026 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:38.667229 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:38.705516 (+ 38287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:38.705522 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:38.705557 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:38.705964 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.705981 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.708314 (+ 2333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.708320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.710400 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.710420 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.712661 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.712671 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.712871 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.712936 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 10:43:38.713027 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:43:38.713182 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7088,"thread_start_us":6877,"threads_started":1}
I20260807 10:43:38.713737 22600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.660090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47560 (local address 127.11.46.131:37093)
0807 10:43:38.704763 (+ 44673us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.704773 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.704812 (+ 39us) server_negotiation.cc:407] Connection header received
0807 10:43:38.704926 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.704934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.705229 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.705488 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:38.706199 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.708112 (+ 1913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.710782 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.712371 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.712525 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.712822 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.713129 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.713321 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44459,"thread_start_us":44237,"threads_started":1}
I20260807 10:43:38.715950 22606 tablet_bootstrap.cc:492] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: Bootstrap starting.
I20260807 10:43:38.718043 22458 tablet_service.cc:1467] Processing CreateTablet for tablet 8faae2b7caf94719b5270849d353f4e4 (DEFAULT_TABLE table=test-table [id=f43a314a95b54baeb40d70a1767c4daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:38.719488 22458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8faae2b7caf94719b5270849d353f4e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:38.720718 22606 tablet_bootstrap.cc:654] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:38.722275 22606 log.cc:824] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:38.730942 22607 tablet_bootstrap.cc:492] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: Bootstrap starting.
I20260807 10:43:38.735339 22607 tablet_bootstrap.cc:654] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:38.735782 22606 tablet_bootstrap.cc:492] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: No bootstrap required, opened a new log
I20260807 10:43:38.736141 22606 ts_tablet_manager.cc:1397] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.008s
I20260807 10:43:38.736310 22611 tablet_bootstrap.cc:492] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: Bootstrap starting.
I20260807 10:43:38.736927 22607 log.cc:824] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:38.740149 22611 tablet_bootstrap.cc:654] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:38.740929 22607 tablet_bootstrap.cc:492] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: No bootstrap required, opened a new log
I20260807 10:43:38.741294 22607 ts_tablet_manager.cc:1397] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260807 10:43:38.741376 22611 log.cc:824] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:38.745417 22611 tablet_bootstrap.cc:492] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: No bootstrap required, opened a new log
I20260807 10:43:38.745785 22611 ts_tablet_manager.cc:1397] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260807 10:43:38.748034 22606 raft_consensus.cc:348] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:38.748592 22606 raft_consensus.cc:374] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:38.748715 22606 raft_consensus.cc:729] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6e57e82faa41e78d7f61ada26f5379, State: Initialized, Role: FOLLOWER
I20260807 10:43:38.749550 22606 consensus_queue.cc:260] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:38.751753 22606 ts_tablet_manager.cc:1428] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: Time spent starting tablet: real 0.015s user 0.010s sys 0.006s
I20260807 10:43:38.752651 22607 raft_consensus.cc:348] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:38.753134 22607 raft_consensus.cc:374] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:38.753240 22607 raft_consensus.cc:729] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4365b17c51407ea3622f273f296f69, State: Initialized, Role: FOLLOWER
I20260807 10:43:38.754031 22607 consensus_queue.cc:260] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:38.756578 22611 raft_consensus.cc:348] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:38.757164 22611 raft_consensus.cc:374] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:38.757530 22611 raft_consensus.cc:729] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b4a5b95b0a46d986cdc9cdf8af590d, State: Initialized, Role: FOLLOWER
I20260807 10:43:38.758395 22611 consensus_queue.cc:260] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:38.762640 22346 heartbeater.cc:503] Master 127.11.46.190:44715 was elected leader, sending a full tablet report...
I20260807 10:43:38.762908 22607 ts_tablet_manager.cc:1428] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: Time spent starting tablet: real 0.021s user 0.018s sys 0.004s
I20260807 10:43:38.765657 22555 heartbeater.cc:503] Master 127.11.46.190:44715 was elected leader, sending a full tablet report...
I20260807 10:43:38.766237 22611 ts_tablet_manager.cc:1428] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: Time spent starting tablet: real 0.020s user 0.009s sys 0.008s
I20260807 10:43:38.768296 22616 raft_consensus.cc:482] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:43:38.769670 22616 raft_consensus.cc:504] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:38.771831 22616 leader_election.cc:288] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093), 4f6e57e82faa41e78d7f61ada26f5379 (127.11.46.129:43459)
I20260807 10:43:38.779150 22600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.772229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:42181 (local address 127.11.46.131:37093)
0807 10:43:38.772428 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.772434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.772934 (+ 500us) server_negotiation.cc:407] Connection header received
0807 10:43:38.773347 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.773351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.773412 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.773525 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:38.774130 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.774879 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.777188 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.778204 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.778376 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.778466 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.778770 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.778908 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 10:43:38.779165 22602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.772888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:57963 (local address 127.11.46.129:43459)
0807 10:43:38.773099 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.773103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.773118 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:43:38.773270 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.773276 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.773357 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.773467 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:38.774144 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.774887 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.777219 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.778179 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.778340 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.778432 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.778753 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.778903 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:43:38.779366 22622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.772228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:43459 (local address 127.11.46.130:57963)
0807 10:43:38.772995 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:38.773010 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:38.773122 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:38.773544 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:38.773549 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:38.773575 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:38.773949 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.773973 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.775025 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.775031 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.777027 (+ 1996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.777046 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.778407 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.778413 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.778579 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.778613 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 10:43:38.778696 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 10:43:38.778845 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"mutex_wait_us":55,"thread_start_us":462,"threads_started":1}
I20260807 10:43:38.779642 22621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.772046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:37093 (local address 127.11.46.130:42181)
0807 10:43:38.772815 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:38.772839 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:38.773216 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:38.773568 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:38.773573 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:38.773599 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:38.773983 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.773993 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.775030 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.775035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.777047 (+ 2012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:38.777061 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.778447 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.778454 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:38.778612 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.778635 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 10:43:38.778723 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 10:43:38.778861 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"mutex_wait_us":46,"thread_start_us":378,"threads_started":1}
I20260807 10:43:38.780553 22091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8faae2b7caf94719b5270849d353f4e4" candidate_uuid: "fa4365b17c51407ea3622f273f296f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6e57e82faa41e78d7f61ada26f5379" is_pre_election: true
I20260807 10:43:38.780583 22484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8faae2b7caf94719b5270849d353f4e4" candidate_uuid: "fa4365b17c51407ea3622f273f296f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" is_pre_election: true
I20260807 10:43:38.781095 22484 raft_consensus.cc:2454] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4365b17c51407ea3622f273f296f69 in term 0.
I20260807 10:43:38.781096 22091 raft_consensus.cc:2454] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa4365b17c51407ea3622f273f296f69 in term 0.
I20260807 10:43:38.781813 22198 leader_election.cc:302] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6e57e82faa41e78d7f61ada26f5379, fa4365b17c51407ea3622f273f296f69; no voters:
I20260807 10:43:38.782248 22616 raft_consensus.cc:2781] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:43:38.782419 22616 raft_consensus.cc:482] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:43:38.782550 22616 raft_consensus.cc:3037] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:38.784960 22616 raft_consensus.cc:504] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:38.785749 22616 leader_election.cc:288] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [CANDIDATE]: Term 1 election: Requested vote from peers 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093), 4f6e57e82faa41e78d7f61ada26f5379 (127.11.46.129:43459)
I20260807 10:43:38.786360 22484 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8faae2b7caf94719b5270849d353f4e4" candidate_uuid: "fa4365b17c51407ea3622f273f296f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d"
I20260807 10:43:38.786418 22091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8faae2b7caf94719b5270849d353f4e4" candidate_uuid: "fa4365b17c51407ea3622f273f296f69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f6e57e82faa41e78d7f61ada26f5379"
I20260807 10:43:38.786597 22484 raft_consensus.cc:3037] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:38.786662 22091 raft_consensus.cc:3037] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:38.789166 22091 raft_consensus.cc:2454] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4365b17c51407ea3622f273f296f69 in term 1.
I20260807 10:43:38.789170 22484 raft_consensus.cc:2454] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa4365b17c51407ea3622f273f296f69 in term 1.
I20260807 10:43:38.789795 22200 leader_election.cc:302] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4f6e57e82faa41e78d7f61ada26f5379, 98b4a5b95b0a46d986cdc9cdf8af590d, fa4365b17c51407ea3622f273f296f69; no voters:
I20260807 10:43:38.790232 22616 raft_consensus.cc:2781] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:38.790779 22616 raft_consensus.cc:686] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 1 LEADER]: Becoming Leader. State: Replica: fa4365b17c51407ea3622f273f296f69, State: Running, Role: LEADER
I20260807 10:43:38.791333 22616 consensus_queue.cc:237] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:38.796797 20779 catalog_manager.cc:5495] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa4365b17c51407ea3622f273f296f69 (127.11.46.130). New cstate: current_term: 1 leader_uuid: "fa4365b17c51407ea3622f273f296f69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } health_report { overall_health: UNKNOWN } } }
W20260807 10:43:38.817775 22559 tablet.cc:2369] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:38.836241 22603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.830687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38418 (local address 127.11.46.130:44463)
0807 10:43:38.830908 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.830915 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.830937 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:43:38.831104 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.831108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.831209 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.831360 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:38.831780 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.832495 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.833927 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.834346 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.834481 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.835000 (+ 519us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:38.835594 (+ 594us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:38.835736 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.835852 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.835948 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:43:38.846060 22091 raft_consensus.cc:1261] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379 [term 1 FOLLOWER]: Refusing update from remote peer fa4365b17c51407ea3622f273f296f69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:38.846060 22484 raft_consensus.cc:1261] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 1 FOLLOWER]: Refusing update from remote peer fa4365b17c51407ea3622f273f296f69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:38.847348 22623 consensus_queue.cc:1035] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:38.847785 22616 consensus_queue.cc:1035] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:38.862361 22626 mvcc.cc:205] Tried to move back new op lower bound from 7315863219580674048 to 7315863219373817856. Current Snapshot: MvccSnapshot[applied={T|T < 7315863219580674048}]
I20260807 10:43:38.888247 20779 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:38.888546 20779 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:38.897986 20779 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b8a1d75033ee46cbae07cad9064b6be1: Sending DeleteTablet for 3 replicas of tablet 8faae2b7caf94719b5270849d353f4e4
I20260807 10:43:38.899250 22458 tablet_service.cc:1514] Processing DeleteTablet for tablet 8faae2b7caf94719b5270849d353f4e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:38 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:47560
I20260807 10:43:38.899358 22063 tablet_service.cc:1514] Processing DeleteTablet for tablet 8faae2b7caf94719b5270849d353f4e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:38 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:53866
I20260807 10:43:38.900354 22641 tablet_replica.cc:330] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: stopping tablet replica
I20260807 10:43:38.900889 22641 raft_consensus.cc:2229] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:38.901933 22258 tablet_service.cc:1514] Processing DeleteTablet for tablet 8faae2b7caf94719b5270849d353f4e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:38 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:38406
I20260807 10:43:38.910717 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 20733
I20260807 10:43:38.910741 22640 tablet_replica.cc:330] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: stopping tablet replica
I20260807 10:43:38.911624 22640 raft_consensus.cc:2229] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:38.911917 20821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:38.912461 22640 raft_consensus.cc:2258] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:38.913035 22641 raft_consensus.cc:2258] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:38.914438 22645 tablet_replica.cc:330] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: stopping tablet replica
I20260807 10:43:38.914902 22645 raft_consensus.cc:2229] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:43:38.915315 22640 ts_tablet_manager.cc:1905] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:38.916838 22645 raft_consensus.cc:2258] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:38.920974 22641 ts_tablet_manager.cc:1905] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:38.923830 22645 ts_tablet_manager.cc:1905] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:38.923887 22640 ts_tablet_manager.cc:1918] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:38.924804 22640 log.cc:1196] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/8faae2b7caf94719b5270849d353f4e4
I20260807 10:43:38.925740 22640 ts_tablet_manager.cc:1939] T 8faae2b7caf94719b5270849d353f4e4 P 4f6e57e82faa41e78d7f61ada26f5379: Deleting consensus metadata
I20260807 10:43:38.933153 22645 ts_tablet_manager.cc:1918] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:38.933369 22645 log.cc:1196] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/8faae2b7caf94719b5270849d353f4e4
I20260807 10:43:38.934031 22645 ts_tablet_manager.cc:1939] T 8faae2b7caf94719b5270849d353f4e4 P fa4365b17c51407ea3622f273f296f69: Deleting consensus metadata
I20260807 10:43:38.937561 22641 ts_tablet_manager.cc:1918] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:38.937815 22641 log.cc:1196] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/8faae2b7caf94719b5270849d353f4e4
I20260807 10:43:38.938424 22641 ts_tablet_manager.cc:1939] T 8faae2b7caf94719b5270849d353f4e4 P 98b4a5b95b0a46d986cdc9cdf8af590d: Deleting consensus metadata
I20260807 10:43:38.942065 22563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.902874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47106 (local address 127.11.46.189:34107)
0807 10:43:38.903080 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.903087 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.907724 (+ 4637us) server_negotiation.cc:407] Connection header received
0807 10:43:38.907925 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.907930 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.908014 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.908133 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:38.910807 (+ 2674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.911888 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.915748 (+ 3860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.916370 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.916526 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.934973 (+ 18447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:38.934981 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:38.934987 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:38.935043 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:38.938695 (+ 3652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.939739 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.939744 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.939748 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.939919 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.940319 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.940324 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.940327 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.940700 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:38.940899 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.941373 (+ 474us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.941677 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 10:43:38.961087 22581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:38.907853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45690 (local address 127.11.46.188:41877)
0807 10:43:38.908104 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:38.908110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:38.942288 (+ 34178us) server_negotiation.cc:407] Connection header received
0807 10:43:38.942789 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:38.942795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:38.942882 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:38.942949 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:38.945153 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.946215 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.948296 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:38.949155 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:38.949297 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:38.953119 (+ 3822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:38.953128 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:38.953133 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:38.953189 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:38.956853 (+ 3664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.957925 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.957932 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.957936 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.958136 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:38.958577 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:38.958582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:38.958586 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:38.958957 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:38.959227 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:38.960448 (+ 1221us) server_negotiation.cc:299] Negotiation successful
0807 10:43:38.960718 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:43:39.075263 20759 catalog_manager.cc:4841] TS 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093): tablet 8faae2b7caf94719b5270849d353f4e4 (table test-table [id=f43a314a95b54baeb40d70a1767c4daa]) successfully deleted
I20260807 10:43:39.075693 20759 catalog_manager.cc:4841] TS fa4365b17c51407ea3622f273f296f69 (127.11.46.130:44463): tablet 8faae2b7caf94719b5270849d353f4e4 (table test-table [id=f43a314a95b54baeb40d70a1767c4daa]) successfully deleted
I20260807 10:43:39.075837 20757 catalog_manager.cc:4841] TS 4f6e57e82faa41e78d7f61ada26f5379 (127.11.46.129:43459): tablet 8faae2b7caf94719b5270849d353f4e4 (table test-table [id=f43a314a95b54baeb40d70a1767c4daa]) successfully deleted
I20260807 10:43:39.076270 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 20733
I20260807 10:43:39.134929 22563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:39.116007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47120 (local address 127.11.46.189:34107)
0807 10:43:39.116222 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:39.116228 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:39.117336 (+ 1108us) server_negotiation.cc:407] Connection header received
0807 10:43:39.117543 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:39.117550 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:39.117659 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:39.117803 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:39.120053 (+ 2250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:39.121175 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:39.122740 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:39.123218 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:39.123345 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:39.127016 (+ 3671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:39.127024 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:39.127029 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:39.127084 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:39.131333 (+ 4249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:39.132307 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:39.132313 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:39.132317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:39.132497 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:39.133003 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:39.133009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:39.133012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:39.133546 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:39.133818 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:39.134373 (+ 555us) server_negotiation.cc:299] Negotiation successful
0807 10:43:39.134628 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:43:39.138089 22581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:39.120182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45704 (local address 127.11.46.188:41877)
0807 10:43:39.120389 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:39.120395 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:39.120680 (+ 285us) server_negotiation.cc:407] Connection header received
0807 10:43:39.120835 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:39.120841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:39.120934 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:39.121187 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:39.123672 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:39.124767 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:39.126763 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:39.127269 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:39.127416 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:39.130251 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:39.130258 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:39.130262 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:39.130306 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:39.133916 (+ 3610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:39.135293 (+ 1377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:39.135301 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:39.135304 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:39.135480 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:39.136515 (+ 1035us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:39.136520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:39.136523 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:39.136853 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:39.137131 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:39.137498 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 10:43:39.137757 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:43:39.878194 22657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:39.877289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.129:35899)
0807 10:43:39.877835 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:39.878006 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":289,"threads_started":1}
W20260807 10:43:39.878753 22157 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:44715 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
I20260807 10:43:39.879086 22653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:39.877262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.130:55543)
0807 10:43:39.878732 (+ 1470us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:39.878879 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1361,"thread_start_us":1238,"threads_started":1}
W20260807 10:43:39.879521 22346 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:44715 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
I20260807 10:43:39.886114 22659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:39.883961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.131:51635)
0807 10:43:39.885595 (+ 1634us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:39.885834 (+ 239us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1404,"thread_start_us":1295,"threads_started":1}
W20260807 10:43:39.886678 22555 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:44715 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
I20260807 10:43:40.397233 22661 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8a1d75033ee46cbae07cad9064b6be1)
I20260807 10:43:40.397624 22661 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } }
I20260807 10:43:40.398177 22662 raft_consensus.cc:482] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8a1d75033ee46cbae07cad9064b6be1)
I20260807 10:43:40.398358 22662 raft_consensus.cc:504] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } }
I20260807 10:43:40.399317 22661 leader_election.cc:288] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8a1d75033ee46cbae07cad9064b6be1 (127.11.46.190:44715), 051db34e187143b5bd6d02ddb1bf6f4a (127.11.46.188:41877)
I20260807 10:43:40.399138 22662 leader_election.cc:288] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8a1d75033ee46cbae07cad9064b6be1 (127.11.46.190:44715), 47dafdcdc8314ab1bf7eb00498241cc0 (127.11.46.189:34107)
I20260807 10:43:40.411167 22664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.399429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44836)
0807 10:43:40.410526 (+ 11097us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.410823 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10957,"thread_start_us":10768,"threads_started":1}
I20260807 10:43:40.413043 22666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.399389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44824)
0807 10:43:40.412398 (+ 13009us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.412683 (+ 285us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12859,"thread_start_us":13208,"threads_started":1}
W20260807 10:43:40.413960 21603 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
W20260807 10:43:40.414781 21892 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
I20260807 10:43:40.416575 22668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.415827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44850)
0807 10:43:40.416085 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.416301 (+ 216us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 10:43:40.417012 21603 leader_election.cc:334] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8a1d75033ee46cbae07cad9064b6be1 (127.11.46.190:44715): Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
I20260807 10:43:40.419448 22666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.418773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44860)
0807 10:43:40.419039 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.419180 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
W20260807 10:43:40.419739 21892 leader_election.cc:334] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b8a1d75033ee46cbae07cad9064b6be1 (127.11.46.190:44715): Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
I20260807 10:43:40.421784 22667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.399612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42234 (local address 127.11.46.189:34107)
0807 10:43:40.410380 (+ 10768us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:40.410388 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:40.413020 (+ 2632us) server_negotiation.cc:407] Connection header received
0807 10:43:40.413333 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:40.413340 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:40.413480 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:40.413678 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:40.415171 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.416580 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.419455 (+ 2875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.420623 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.420756 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.420855 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:40.421227 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 10:43:40.421373 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":10537,"thread_start_us":10268,"threads_started":1}
I20260807 10:43:40.421831 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.399398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:34107 (local address 127.0.0.1:42234)
0807 10:43:40.412897 (+ 13499us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.412916 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:40.413152 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:40.414032 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:40.414038 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:40.414071 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:40.414909 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.414929 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.416780 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.416785 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.419166 (+ 2381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.419192 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.420812 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.420818 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.421045 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.421078 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:43:40.421167 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 10:43:40.421334 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13391,"mutex_wait_us":271,"thread_start_us":12564,"threads_started":1}
I20260807 10:43:40.422524 21634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" is_pre_election: true
I20260807 10:43:40.422840 21634 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051db34e187143b5bd6d02ddb1bf6f4a in term 1.
I20260807 10:43:40.423087 22669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.412896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38490 (local address 127.11.46.188:41877)
0807 10:43:40.414772 (+ 1876us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:40.414778 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:40.414800 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:43:40.414869 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:40.414879 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:40.414970 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:40.415915 (+ 945us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:40.416179 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.418085 (+ 1906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.420817 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.421825 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.422172 (+ 347us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.422271 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:40.422593 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 10:43:40.422737 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":1676,"thread_start_us":1471,"threads_started":1}
I20260807 10:43:40.423137 22664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.411217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:41877 (local address 127.0.0.1:38490)
0807 10:43:40.411538 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.411560 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:40.411744 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:40.415150 (+ 3406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:40.415155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:40.415208 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:40.415726 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.415742 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.418348 (+ 2606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.418353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.420620 (+ 2267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.420638 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.422232 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.422239 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.422418 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.422447 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 10:43:40.422545 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 10:43:40.422706 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":8,"thread_start_us":2406,"threads_started":1}
I20260807 10:43:40.423516 21893 leader_election.cc:302] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 051db34e187143b5bd6d02ddb1bf6f4a, 47dafdcdc8314ab1bf7eb00498241cc0; no voters: b8a1d75033ee46cbae07cad9064b6be1
I20260807 10:43:40.423780 21922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" is_pre_election: true
I20260807 10:43:40.423915 22662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 10:43:40.424052 22662 raft_consensus.cc:482] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8a1d75033ee46cbae07cad9064b6be1)
I20260807 10:43:40.424165 22662 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:43:40.427052 22662 raft_consensus.cc:504] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } }
I20260807 10:43:40.427879 21922 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47dafdcdc8314ab1bf7eb00498241cc0 in current term 2: Already voted for candidate 051db34e187143b5bd6d02ddb1bf6f4a in this term.
I20260807 10:43:40.428002 22662 leader_election.cc:288] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [CANDIDATE]: Term 2 election: Requested vote from peers b8a1d75033ee46cbae07cad9064b6be1 (127.11.46.190:44715), 47dafdcdc8314ab1bf7eb00498241cc0 (127.11.46.189:34107)
I20260807 10:43:40.428803 21634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "47dafdcdc8314ab1bf7eb00498241cc0"
I20260807 10:43:40.429071 21634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:43:40.429114 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.428395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44864)
0807 10:43:40.428688 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.428879 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260807 10:43:40.431361 21603 leader_election.cc:302] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47dafdcdc8314ab1bf7eb00498241cc0; no voters: 051db34e187143b5bd6d02ddb1bf6f4a, b8a1d75033ee46cbae07cad9064b6be1
I20260807 10:43:40.432727 21634 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051db34e187143b5bd6d02ddb1bf6f4a in term 2.
I20260807 10:43:40.433036 22661 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 10:43:40.433336 21893 leader_election.cc:302] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051db34e187143b5bd6d02ddb1bf6f4a, 47dafdcdc8314ab1bf7eb00498241cc0; no voters:
I20260807 10:43:40.433615 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.432823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44882)
0807 10:43:40.433119 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.433240 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260807 10:43:40.433869 22662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 2 FOLLOWER]: Leader election won for term 2
W20260807 10:43:40.433907 21892 leader_election.cc:334] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b8a1d75033ee46cbae07cad9064b6be1 (127.11.46.190:44715): Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
I20260807 10:43:40.434657 22662 raft_consensus.cc:686] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [term 2 LEADER]: Becoming Leader. State: Replica: 051db34e187143b5bd6d02ddb1bf6f4a, State: Running, Role: LEADER
I20260807 10:43:40.435273 22662 consensus_queue.cc:237] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } }
I20260807 10:43:40.438128 22673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 051db34e187143b5bd6d02ddb1bf6f4a. Latest consensus state: current_term: 2 leader_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:40.438712 22673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:40.439558 22675 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:40.443785 22675 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:40.444726 22675 catalog_manager.cc:1259] Loaded cluster ID: efd4533c4e5b4b63888aa197d1f36848
I20260807 10:43:40.444825 22675 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:40.446172 22675 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:40.447114 22675 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Loaded TSK: 0
I20260807 10:43:40.448108 22675 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:43:40.491245 21908 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45704:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:43:40.499153 21908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:43:40.505115 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.504575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44902)
0807 10:43:40.504787 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.504904 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 10:43:40.506346 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.505900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44914)
0807 10:43:40.506137 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.506210 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260807 10:43:40.506548 21892 consensus_peers.cc:487] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a -> Peer b8a1d75033ee46cbae07cad9064b6be1 (127.11.46.190:44715): Couldn't send request to peer b8a1d75033ee46cbae07cad9064b6be1. Status: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 10:43:40.508538 21634 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [term 2 FOLLOWER]: Refusing update from remote peer 051db34e187143b5bd6d02ddb1bf6f4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 10:43:40.509627 22673 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260807 10:43:40.513271 22661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 051db34e187143b5bd6d02ddb1bf6f4a. Latest consensus state: current_term: 2 leader_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:40.513620 22661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:43:40.515370 22662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:40.515785 22662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:40.516264 22661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "b8a1d75033ee46cbae07cad9064b6be1" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44715 } } peers { permanent_uuid: "47dafdcdc8314ab1bf7eb00498241cc0" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 34107 } attrs { promote: false } } peers { permanent_uuid: "051db34e187143b5bd6d02ddb1bf6f4a" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 41877 } attrs { promote: false } } }
I20260807 10:43:40.516584 22661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47dafdcdc8314ab1bf7eb00498241cc0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:43:40.534520 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.526370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:44463 (local address 127.0.0.1:43092)
0807 10:43:40.526569 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.526592 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:40.526707 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:40.527377 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:40.527382 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:40.527413 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:40.527663 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.527677 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.529242 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.529247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.531872 (+ 2625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.531894 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.533584 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.533590 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.533871 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.533912 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 10:43:40.534000 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 10:43:40.534157 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":24}
I20260807 10:43:40.535284 22666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.527452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:37093 (local address 127.0.0.1:44288)
0807 10:43:40.527607 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.527627 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:40.527730 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:40.528820 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:40.528826 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:40.528858 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:40.529200 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.529214 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.530694 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.530701 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.532996 (+ 2295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.533013 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.534708 (+ 1695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.534714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.534858 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.534885 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 10:43:40.534959 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 10:43:40.535074 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":23}
I20260807 10:43:40.535537 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.527649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44288 (local address 127.11.46.131:37093)
0807 10:43:40.528155 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:40.528161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:40.528182 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:43:40.528256 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:40.528261 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:40.528354 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:40.528452 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:40.529584 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.530521 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.533189 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.534453 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.534600 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.534723 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:40.535024 (+ 301us) server_negotiation.cc:299] Negotiation successful
0807 10:43:40.535201 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":255,"threads_started":1}
I20260807 10:43:40.535579 22683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.526443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43092 (local address 127.11.46.130:44463)
0807 10:43:40.526987 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:40.526993 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:40.527015 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:43:40.527099 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:40.527104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:40.527198 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:40.527815 (+ 617us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:40.528015 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.529058 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.532167 (+ 3109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.533343 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.534926 (+ 1583us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.535063 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:40.535119 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 10:43:40.535285 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":285,"threads_started":1}
I20260807 10:43:40.536458 22458 tablet_service.cc:1467] Processing CreateTablet for tablet b69f6a2afc3847a493f32489c13838d1 (DEFAULT_TABLE table=test-table [id=0406ebdada644fb5b5205ad3bbb4098d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:40.536564 22258 tablet_service.cc:1467] Processing CreateTablet for tablet b69f6a2afc3847a493f32489c13838d1 (DEFAULT_TABLE table=test-table [id=0406ebdada644fb5b5205ad3bbb4098d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:40.537030 22258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b69f6a2afc3847a493f32489c13838d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:40.537042 22458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b69f6a2afc3847a493f32489c13838d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:40.538932 22685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.528427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:43459 (local address 127.0.0.1:46980)
0807 10:43:40.529088 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.529110 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:40.529250 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:40.530456 (+ 1206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:40.530460 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:40.530490 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:40.531145 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.531158 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.532296 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.532302 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.534526 (+ 2224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.534541 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.538007 (+ 3466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.538016 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.538214 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.538251 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:43:40.538347 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 10:43:40.538519 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"mutex_wait_us":48,"thread_start_us":833,"threads_started":1}
I20260807 10:43:40.539733 22686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.528899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46980 (local address 127.11.46.129:43459)
0807 10:43:40.530117 (+ 1218us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:40.530123 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:40.530144 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:43:40.530217 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:40.530222 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:40.530299 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:40.530408 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:40.531334 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.532160 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.535965 (+ 3805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.537169 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.537706 (+ 537us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.537834 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:40.539184 (+ 1350us) server_negotiation.cc:299] Negotiation successful
0807 10:43:40.539392 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1092,"thread_start_us":973,"threads_started":1}
I20260807 10:43:40.540606 22063 tablet_service.cc:1467] Processing CreateTablet for tablet b69f6a2afc3847a493f32489c13838d1 (DEFAULT_TABLE table=test-table [id=0406ebdada644fb5b5205ad3bbb4098d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:40.541126 22063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b69f6a2afc3847a493f32489c13838d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:40.551586 22689 tablet_bootstrap.cc:492] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d: Bootstrap starting.
I20260807 10:43:40.554003 22689 tablet_bootstrap.cc:654] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:40.554078 22687 tablet_bootstrap.cc:492] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: Bootstrap starting.
I20260807 10:43:40.556221 22687 tablet_bootstrap.cc:654] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:40.557258 22689 tablet_bootstrap.cc:492] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d: No bootstrap required, opened a new log
I20260807 10:43:40.557485 22689 ts_tablet_manager.cc:1397] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 10:43:40.558457 22689 raft_consensus.cc:348] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:40.558686 22689 raft_consensus.cc:374] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:40.558777 22689 raft_consensus.cc:729] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b4a5b95b0a46d986cdc9cdf8af590d, State: Initialized, Role: FOLLOWER
I20260807 10:43:40.559113 22689 consensus_queue.cc:260] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:40.559885 22687 tablet_bootstrap.cc:492] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: No bootstrap required, opened a new log
I20260807 10:43:40.560066 22690 tablet_bootstrap.cc:492] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: Bootstrap starting.
I20260807 10:43:40.560102 22689 ts_tablet_manager.cc:1428] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 10:43:40.560120 22687 ts_tablet_manager.cc:1397] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 10:43:40.561216 22687 raft_consensus.cc:348] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:40.561630 22687 raft_consensus.cc:374] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:40.561802 22687 raft_consensus.cc:729] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa4365b17c51407ea3622f273f296f69, State: Initialized, Role: FOLLOWER
I20260807 10:43:40.562008 22696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.560875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.131:54571)
0807 10:43:40.561575 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.561753 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"threads_started":1}
I20260807 10:43:40.562153 22690 tablet_bootstrap.cc:654] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:40.562296 22687 consensus_queue.cc:260] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:40.563378 22687 ts_tablet_manager.cc:1428] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 10:43:40.565937 22696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.565364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.131:41429)
0807 10:43:40.565659 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.565763 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173}
I20260807 10:43:40.567809 22552 heartbeater.cc:503] Master 127.11.46.188:41877 was elected leader, sending a full tablet report...
I20260807 10:43:40.570369 22345 heartbeater.cc:503] Master 127.11.46.188:41877 was elected leader, sending a full tablet report...
I20260807 10:43:40.570772 22699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.564146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.130:54521)
0807 10:43:40.570299 (+ 6153us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.570508 (+ 209us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5939,"thread_start_us":5748,"threads_started":1}
I20260807 10:43:40.572305 22699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.571843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.130:45329)
0807 10:43:40.572041 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.572138 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 10:43:40.573156 22690 tablet_bootstrap.cc:492] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: No bootstrap required, opened a new log
I20260807 10:43:40.573342 22690 ts_tablet_manager.cc:1397] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260807 10:43:40.574244 22690 raft_consensus.cc:348] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:40.574478 22690 raft_consensus.cc:374] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:40.574559 22690 raft_consensus.cc:729] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f6e57e82faa41e78d7f61ada26f5379, State: Initialized, Role: FOLLOWER
I20260807 10:43:40.575076 22690 consensus_queue.cc:260] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:40.576419 22690 ts_tablet_manager.cc:1428] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 10:43:40.578002 22704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.576726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.129:48919)
0807 10:43:40.577520 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.577708 (+ 188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":455,"threads_started":1}
I20260807 10:43:40.579407 22704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.578864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.129:43161)
0807 10:43:40.579057 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.579175 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 10:43:40.579669 22154 heartbeater.cc:503] Master 127.11.46.188:41877 was elected leader, sending a full tablet report...
W20260807 10:43:40.648366 22349 tablet.cc:2369] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:43:40.697160 22159 tablet.cc:2369] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:40.717595 22703 raft_consensus.cc:482] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:43:40.717881 22703 raft_consensus.cc:504] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:40.719739 22703 leader_election.cc:288] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa4365b17c51407ea3622f273f296f69 (127.11.46.130:44463), 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093)
I20260807 10:43:40.726912 22683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.720172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:51359 (local address 127.11.46.130:44463)
0807 10:43:40.720363 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:40.720369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:40.720391 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:43:40.720703 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:40.720709 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:40.720798 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:40.720898 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:40.721606 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.722532 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.724766 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.725842 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.726037 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.726126 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:40.726468 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 10:43:40.726609 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:43:40.726989 22704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.720050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:44463 (local address 127.11.46.129:51359)
0807 10:43:40.720280 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.720303 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:40.720517 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:40.721035 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:40.721039 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:40.721065 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:40.721408 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.721421 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.722676 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.722681 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.724577 (+ 1896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.724591 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.726082 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.726089 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.726295 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.726326 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 10:43:40.726425 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 10:43:40.726603 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":38,"spinlock_wait_cycles":26240}
I20260807 10:43:40.727156 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.720654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:48133 (local address 127.11.46.131:37093)
0807 10:43:40.720850 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:40.720856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:40.721203 (+ 347us) server_negotiation.cc:407] Connection header received
0807 10:43:40.721374 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:40.721380 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:40.721498 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:40.721585 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:40.722147 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.723004 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.724919 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.725964 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.726123 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.726189 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:40.726724 (+ 535us) server_negotiation.cc:299] Negotiation successful
0807 10:43:40.726872 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:43:40.727773 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.720497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:37093 (local address 127.11.46.129:48133)
0807 10:43:40.721089 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.721109 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:40.721234 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:40.721608 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:40.721612 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:40.721637 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:40.722006 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.722019 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.723139 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.723143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.724745 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:40.724760 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.726339 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.726345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:40.726527 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.726559 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 10:43:40.727238 (+ 679us) client_negotiation.cc:240] Negotiation successful
0807 10:43:40.727393 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":2,"spinlock_wait_cycles":1408,"thread_start_us":296,"threads_started":1}
I20260807 10:43:40.728328 22288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b69f6a2afc3847a493f32489c13838d1" candidate_uuid: "4f6e57e82faa41e78d7f61ada26f5379" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4365b17c51407ea3622f273f296f69" is_pre_election: true
I20260807 10:43:40.728797 22288 raft_consensus.cc:2454] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6e57e82faa41e78d7f61ada26f5379 in term 0.
I20260807 10:43:40.728776 22483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b69f6a2afc3847a493f32489c13838d1" candidate_uuid: "4f6e57e82faa41e78d7f61ada26f5379" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" is_pre_election: true
I20260807 10:43:40.729126 22483 raft_consensus.cc:2454] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f6e57e82faa41e78d7f61ada26f5379 in term 0.
I20260807 10:43:40.729480 21998 leader_election.cc:302] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6e57e82faa41e78d7f61ada26f5379, fa4365b17c51407ea3622f273f296f69; no voters:
I20260807 10:43:40.729957 22703 raft_consensus.cc:2781] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:43:40.730093 22703 raft_consensus.cc:482] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:43:40.730201 22703 raft_consensus.cc:3037] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:40.732795 22703 raft_consensus.cc:504] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:40.733573 22703 leader_election.cc:288] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [CANDIDATE]: Term 1 election: Requested vote from peers fa4365b17c51407ea3622f273f296f69 (127.11.46.130:44463), 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093)
I20260807 10:43:40.734292 22288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b69f6a2afc3847a493f32489c13838d1" candidate_uuid: "4f6e57e82faa41e78d7f61ada26f5379" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa4365b17c51407ea3622f273f296f69"
I20260807 10:43:40.734326 22483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b69f6a2afc3847a493f32489c13838d1" candidate_uuid: "4f6e57e82faa41e78d7f61ada26f5379" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d"
I20260807 10:43:40.734526 22288 raft_consensus.cc:3037] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:40.734580 22483 raft_consensus.cc:3037] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:40.736865 22483 raft_consensus.cc:2454] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6e57e82faa41e78d7f61ada26f5379 in term 1.
I20260807 10:43:40.736950 22288 raft_consensus.cc:2454] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f6e57e82faa41e78d7f61ada26f5379 in term 1.
I20260807 10:43:40.737490 21998 leader_election.cc:302] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f6e57e82faa41e78d7f61ada26f5379, 98b4a5b95b0a46d986cdc9cdf8af590d; no voters:
I20260807 10:43:40.737881 22703 raft_consensus.cc:2781] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:40.738394 22703 raft_consensus.cc:686] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 1 LEADER]: Becoming Leader. State: Replica: 4f6e57e82faa41e78d7f61ada26f5379, State: Running, Role: LEADER
I20260807 10:43:40.738852 22703 consensus_queue.cc:237] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } } peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } }
I20260807 10:43:40.739584 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.739120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.129:48941)
0807 10:43:40.739311 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.739441 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 10:43:40.742980 21908 catalog_manager.cc:5495] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f6e57e82faa41e78d7f61ada26f5379 (127.11.46.129). New cstate: current_term: 1 leader_uuid: "4f6e57e82faa41e78d7f61ada26f5379" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f6e57e82faa41e78d7f61ada26f5379" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 43459 } health_report { overall_health: HEALTHY } } }
I20260807 10:43:40.787130 22686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.781794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46986 (local address 127.11.46.129:43459)
0807 10:43:40.781994 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:40.781998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:40.782037 (+ 39us) server_negotiation.cc:407] Connection header received
0807 10:43:40.782263 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:40.782267 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:40.782367 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:40.782525 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:40.782942 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.783667 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.784960 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.785407 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.785567 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.785950 (+ 383us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:40.786608 (+ 658us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:40.786721 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:40.786797 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 10:43:40.786879 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 10:43:40.792232 22483 raft_consensus.cc:1261] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 1 FOLLOWER]: Refusing update from remote peer 4f6e57e82faa41e78d7f61ada26f5379: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:40.792663 22288 raft_consensus.cc:1261] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69 [term 1 FOLLOWER]: Refusing update from remote peer 4f6e57e82faa41e78d7f61ada26f5379: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:40.793107 22706 consensus_queue.cc:1035] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98b4a5b95b0a46d986cdc9cdf8af590d" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 37093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:40.793632 22703 consensus_queue.cc:1035] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa4365b17c51407ea3622f273f296f69" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 44463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:40.796643 22696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.795964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.131:56613)
0807 10:43:40.796252 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.796375 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
I20260807 10:43:40.797778 22699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.797135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.130:59459)
0807 10:43:40.797362 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.797532 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 10:43:40.809772 22709 mvcc.cc:205] Tried to move back new op lower bound from 7315863227556659200 to 7315863227351207936. Current Snapshot: MvccSnapshot[applied={T|T < 7315863227556659200}]
I20260807 10:43:40.812110 22699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.811172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.130:39483)
0807 10:43:40.811716 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.811851 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395}
I20260807 10:43:40.814131 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.813390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.129:38389)
0807 10:43:40.813731 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.813884 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260807 10:43:40.826906 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.826345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.129:42363)
0807 10:43:40.826606 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.826724 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
I20260807 10:43:40.826958 22710 mvcc.cc:205] Tried to move back new op lower bound from 7315863227556659200 to 7315863227351207936. Current Snapshot: MvccSnapshot[applied={T|T < 7315863227556659200}]
I20260807 10:43:40.827246 22696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.826573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.11.46.131:50019)
0807 10:43:40.826808 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:40.826904 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260807 10:43:40.836491 21908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45704:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:40.836850 21908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45704:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:40.844985 21908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 051db34e187143b5bd6d02ddb1bf6f4a: Sending DeleteTablet for 3 replicas of tablet b69f6a2afc3847a493f32489c13838d1
I20260807 10:43:40.846307 22063 tablet_service.cc:1514] Processing DeleteTablet for tablet b69f6a2afc3847a493f32489c13838d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:40 UTC) from {username='oryx', principal='oryx/127.11.46.188@KRBTEST.COM'} at 127.0.0.1:46980
I20260807 10:43:40.846323 22258 tablet_service.cc:1514] Processing DeleteTablet for tablet b69f6a2afc3847a493f32489c13838d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:40 UTC) from {username='oryx', principal='oryx/127.11.46.188@KRBTEST.COM'} at 127.0.0.1:43092
I20260807 10:43:40.847360 22458 tablet_service.cc:1514] Processing DeleteTablet for tablet b69f6a2afc3847a493f32489c13838d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:40 UTC) from {username='oryx', principal='oryx/127.11.46.188@KRBTEST.COM'} at 127.0.0.1:44288
I20260807 10:43:40.847411 22457 tablet_service.cc:1514] Processing DeleteTablet for tablet b69f6a2afc3847a493f32489c13838d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:40 UTC) from {username='oryx', principal='oryx/127.11.46.188@KRBTEST.COM'} at 127.0.0.1:44288
I20260807 10:43:40.847889 22726 tablet_replica.cc:330] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: stopping tablet replica
I20260807 10:43:40.847926 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 21890
I20260807 10:43:40.848122 22726 raft_consensus.cc:2229] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:40.853041 22726 raft_consensus.cc:2258] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:40.855415 22726 ts_tablet_manager.cc:1905] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:40.857515 22725 tablet_replica.cc:330] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: stopping tablet replica
I20260807 10:43:40.857769 22725 raft_consensus.cc:2229] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:43:40.858487 22725 raft_consensus.cc:2258] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:40.859704 22725 ts_tablet_manager.cc:1905] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:40.861492 22727 tablet_replica.cc:330] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d: stopping tablet replica
I20260807 10:43:40.861720 22727 raft_consensus.cc:2229] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:40.862059 22727 raft_consensus.cc:2258] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:40.864225 22726 ts_tablet_manager.cc:1918] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:40.864387 22726 log.cc:1196] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/b69f6a2afc3847a493f32489c13838d1
I20260807 10:43:40.864558 22727 ts_tablet_manager.cc:1905] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:40.864898 22726 ts_tablet_manager.cc:1939] T b69f6a2afc3847a493f32489c13838d1 P fa4365b17c51407ea3622f273f296f69: Deleting consensus metadata
I20260807 10:43:40.866460 21893 catalog_manager.cc:4841] TS fa4365b17c51407ea3622f273f296f69 (127.11.46.130:44463): tablet b69f6a2afc3847a493f32489c13838d1 (table test-table [id=0406ebdada644fb5b5205ad3bbb4098d]) successfully deleted
I20260807 10:43:40.866811 22725 ts_tablet_manager.cc:1918] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:40.866997 22725 log.cc:1196] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/b69f6a2afc3847a493f32489c13838d1
I20260807 10:43:40.867547 22725 ts_tablet_manager.cc:1939] T b69f6a2afc3847a493f32489c13838d1 P 4f6e57e82faa41e78d7f61ada26f5379: Deleting consensus metadata
I20260807 10:43:40.868856 21891 catalog_manager.cc:4841] TS 4f6e57e82faa41e78d7f61ada26f5379 (127.11.46.129:43459): tablet b69f6a2afc3847a493f32489c13838d1 (table test-table [id=0406ebdada644fb5b5205ad3bbb4098d]) successfully deleted
I20260807 10:43:40.873157 22727 ts_tablet_manager.cc:1918] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:40.873342 22727 log.cc:1196] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/b69f6a2afc3847a493f32489c13838d1
I20260807 10:43:40.873878 22727 ts_tablet_manager.cc:1939] T b69f6a2afc3847a493f32489c13838d1 P 98b4a5b95b0a46d986cdc9cdf8af590d: Deleting consensus metadata
I20260807 10:43:40.875334 21893 catalog_manager.cc:4841] TS 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093): tablet b69f6a2afc3847a493f32489c13838d1 (table test-table [id=0406ebdada644fb5b5205ad3bbb4098d]) successfully deleted
W20260807 10:43:40.876410 21893 catalog_manager.cc:4808] TS 98b4a5b95b0a46d986cdc9cdf8af590d (127.11.46.131:37093): delete failed for tablet b69f6a2afc3847a493f32489c13838d1 because the tablet was not found. No further retry: Not found: Tablet not found: b69f6a2afc3847a493f32489c13838d1
I20260807 10:43:40.878343 22686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:40.849155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46998 (local address 127.11.46.129:43459)
0807 10:43:40.849340 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:40.849347 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:40.858127 (+ 8780us) server_negotiation.cc:407] Connection header received
0807 10:43:40.858393 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:40.858402 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:40.858563 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:40.858642 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:40.862376 (+ 3734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.863222 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.867027 (+ 3805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:40.867744 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:40.867868 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:40.871190 (+ 3322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:40.871205 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:40.871224 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:40.871288 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:40.874729 (+ 3441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:40.875692 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:40.875701 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:40.875703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:40.875882 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:40.876389 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:40.876396 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:40.876400 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:40.876979 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:40.877373 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:40.877651 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 10:43:40.877927 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:43:40.879139 22148 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:40.994822 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 21890
I20260807 10:43:41.024959 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 22168
I20260807 10:43:41.040323 22683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:41.025791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43104 (local address 127.11.46.130:44463)
0807 10:43:41.025971 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:41.025975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:41.025996 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:43:41.026133 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:41.026137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:41.026268 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:41.026367 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:41.027685 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:41.028487 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:41.029995 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:41.030434 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:41.030542 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:41.033422 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:41.033492 (+ 70us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:41.033516 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:41.033568 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:41.037092 (+ 3524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:41.038069 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:41.038079 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:41.038081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:41.038268 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:41.038642 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:41.038646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:41.038648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:41.039099 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:41.039417 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:41.039769 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 10:43:41.040032 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:43:41.041159 22339 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:41.051280 22732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:41.050473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44920)
0807 10:43:41.050997 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:41.051093 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":277,"threads_started":1}
I20260807 10:43:41.052784 22732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:41.052376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44926)
0807 10:43:41.052561 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:41.052658 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 10:43:41.172622 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 22168
I20260807 10:43:41.209292 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 22360
I20260807 10:43:41.223992 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:41.210094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44290 (local address 127.11.46.131:37093)
0807 10:43:41.210261 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:41.210266 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:41.210286 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:43:41.210444 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:41.210448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:41.210519 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:41.210630 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:41.212067 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:41.212905 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:41.214332 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:41.214778 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:41.214889 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:41.217972 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:41.217996 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:41.218019 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:41.218066 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:41.221311 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:41.222138 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:41.222148 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:41.222151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:41.222296 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:41.222609 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:41.222612 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:41.222614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:41.223027 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:41.223277 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:41.223509 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 10:43:41.223736 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 10:43:41.224784 22544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:41.323298 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 22360
I20260807 10:43:41.351467 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 21440
I20260807 10:43:41.352624 21663 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:41.466534 22732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:41.466070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44940)
0807 10:43:41.466263 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:41.466359 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 10:43:41.467592 22732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:41.467252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44715 (local address 127.0.0.1:44956)
0807 10:43:41.467388 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:41.467463 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 10:43:41.476655 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 21440
I20260807 10:43:41.511227 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 21582
I20260807 10:43:41.512526 21950 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:41.642769 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 21582
2026-08-07T10:43:41Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10727 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:43:41 dist-test-slave-42z9 krb5kdc[22740](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:43:41 dist-test-slave-42z9 krb5kdc[22740](info): set up 2 sockets
Aug 07 10:43:41 dist-test-slave-42z9 krb5kdc[22740](info): commencing operation
krb5kdc: starting...
W20260807 10:43:42.892721 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.001s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:43:43 dist-test-slave-42z9 krb5kdc[22740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:43:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:43Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.190.keytab.
Entry for principal oryx/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.190.keytab.
I20260807 10:43:43.221808 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36201
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.190.keytab
--principal=oryx/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:40181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:36201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:43.608655 22767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:43.609019 22767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:43.609148 22767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:43.617408 22767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:43.617591 22767 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 10:43:43.617662 22767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:43.617755 22767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:43.617825 22767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:43.617916 22767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:43.629060 22767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:40181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:36201
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.190.keytab
--principal=oryx/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:43.630704 22767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:43.632279 22767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:43.646347 22776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:43.646265 22774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:43.646315 22773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:43.647116 22767 server_base.cc:1034] running on GCE node
I20260807 10:43:43.648093 22767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:43.649919 22767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:43.651204 22767 hybrid_clock.cc:648] HybridClock initialized: now 1786099423651120 us; error 56 us; skew 500 ppm
I20260807 10:43:43.651628 22767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:43 dist-test-slave-42z9 krb5kdc[22740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099423, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:43.658012 22767 init.cc:377] Logged in from keytab as oryx/127.11.46.190@KRBTEST.COM (short username oryx)
I20260807 10:43:43.659885 22767 webserver.cc:460] Webserver started at http://127.11.46.190:39981/ using document root <none> and password file <none>
I20260807 10:43:43.660742 22767 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:43.660867 22767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:43.661224 22767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:43.664721 22767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716"
format_stamp: "Formatted at 2026-08-07 10:43:43 on dist-test-slave-42z9"
server_key: "4f8595c6f27f08c36076819cb02d9b04"
server_key_iv: "147c3e97a914425795f99c7b3b345736"
server_key_version: "encryptionkey@0"
I20260807 10:43:43.665724 22767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716"
format_stamp: "Formatted at 2026-08-07 10:43:43 on dist-test-slave-42z9"
server_key: "4f8595c6f27f08c36076819cb02d9b04"
server_key_iv: "147c3e97a914425795f99c7b3b345736"
server_key_version: "encryptionkey@0"
I20260807 10:43:43.671842 22767 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:43:43.676134 22784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:43.677874 22767 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 10:43:43.678095 22767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716"
format_stamp: "Formatted at 2026-08-07 10:43:43 on dist-test-slave-42z9"
server_key: "4f8595c6f27f08c36076819cb02d9b04"
server_key_iv: "147c3e97a914425795f99c7b3b345736"
server_key_version: "encryptionkey@0"
I20260807 10:43:43.678351 22767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:43.698762 22767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:43.704710 22767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:43.705030 22767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:43.729069 22767 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:36201
I20260807 10:43:43.729076 22866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:36201 every 8 connection(s)
I20260807 10:43:43.730711 22767 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:43.735013 22867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:43.736116 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 22767
I20260807 10:43:43.736310 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:43.736980 11450 external_mini_cluster.cc:1428] Setting key 65afbfecd85522e94a5cabb69a07b12e
I20260807 10:43:43.750536 22867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716: Bootstrap starting.
Aug 07 10:43:43 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:43.754571 22867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:43.756207 22867 log.cc:824] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:43.760020 22867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716: No bootstrap required, opened a new log
I20260807 10:43:43.762984 22870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:43.739176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55558 (local address 127.11.46.190:36201)
0807 10:43:43.740113 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:43.740130 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:43.740191 (+ 61us) server_negotiation.cc:407] Connection header received
0807 10:43:43.742109 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:43.742146 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:43.742764 (+ 618us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:43.743257 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:43.744715 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:43.746740 (+ 2025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:43.748095 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:43.749229 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:43.749428 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:43.753880 (+ 4452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:43.753893 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:43.753916 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:43.753973 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:43.757816 (+ 3843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:43.758678 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:43.758688 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:43.758698 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:43.758938 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:43.759334 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:43.759351 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:43.759354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:43.760155 (+ 801us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:43.760567 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:43.760886 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 10:43:43.761399 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":370,"threads_started":1}
I20260807 10:43:43.769863 22867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36201 } }
I20260807 10:43:43.770301 22867 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:43.770385 22867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c6ca116c7ef469e9ae6ccb6c6dc2716, State: Initialized, Role: FOLLOWER
I20260807 10:43:43.771013 22867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36201 } }
I20260807 10:43:43.771266 22867 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:43.771418 22867 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:43.771643 22867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:43.774250 22867 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36201 } }
I20260807 10:43:43.774879 22867 leader_election.cc:302] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c6ca116c7ef469e9ae6ccb6c6dc2716; no voters:
I20260807 10:43:43.775669 22867 leader_election.cc:288] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:43.775803 22874 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:43.776599 22874 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [term 1 LEADER]: Becoming Leader. State: Replica: 4c6ca116c7ef469e9ae6ccb6c6dc2716, State: Running, Role: LEADER
I20260807 10:43:43.777192 22874 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36201 } }
I20260807 10:43:43.778013 22867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:43.780450 22876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36201 } } }
I20260807 10:43:43.780934 22876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:43.780437 22877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c6ca116c7ef469e9ae6ccb6c6dc2716. Latest consensus state: current_term: 1 leader_uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c6ca116c7ef469e9ae6ccb6c6dc2716" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36201 } } }
I20260807 10:43:43.781147 22877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:43.782739 22881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:43.788782 22881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:43.802032 22881 catalog_manager.cc:1347] Generated new cluster ID: deec3c3b3fa54abe8ca3cb91781adf92
I20260807 10:43:43.802177 22881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:43.804540 22897 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 10:43:43.822894 22881 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:43.825067 22881 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:43.838269 22881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716: Generated new TSK 0
I20260807 10:43:43.839387 22881 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab.
Entry for principal oryx/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab.
I20260807 10:43:43.918695 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36201
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab
--principal=oryx/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:40181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:44.310220 22905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:44.310571 22905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:44.310695 22905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:44.318459 22905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:44.318611 22905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:44.318710 22905 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:43:44.318795 22905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:44.329548 22905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:40181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab
--principal=oryx/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.46.190:36201
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:44.331053 22905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:44.332571 22905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:44.347103 22912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:44.347167 22911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:44.347378 22915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:44.348022 22905 server_base.cc:1034] running on GCE node
I20260807 10:43:44.348801 22905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:44.350030 22905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:44.351289 22905 hybrid_clock.cc:648] HybridClock initialized: now 1786099424351185 us; error 61 us; skew 500 ppm
I20260807 10:43:44.351651 22905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:44 dist-test-slave-42z9 krb5kdc[22740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099424, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:44.355255 22905 init.cc:377] Logged in from keytab as oryx/127.11.46.129@KRBTEST.COM (short username oryx)
I20260807 10:43:44.356990 22905 webserver.cc:460] Webserver started at http://127.11.46.129:44601/ using document root <none> and password file <none>
I20260807 10:43:44.357878 22905 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:44.357987 22905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:44.358311 22905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:44.361720 22905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "c9a8fc20401e49d788a2543b2316e350"
format_stamp: "Formatted at 2026-08-07 10:43:44 on dist-test-slave-42z9"
server_key: "d7c7f7317246b80ef30a2b3827e0bb16"
server_key_iv: "f6c9d8ac8e5020700a0031272ad9015e"
server_key_version: "encryptionkey@0"
I20260807 10:43:44.362623 22905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "c9a8fc20401e49d788a2543b2316e350"
format_stamp: "Formatted at 2026-08-07 10:43:44 on dist-test-slave-42z9"
server_key: "d7c7f7317246b80ef30a2b3827e0bb16"
server_key_iv: "f6c9d8ac8e5020700a0031272ad9015e"
server_key_version: "encryptionkey@0"
I20260807 10:43:44.368799 22905 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:43:44.373010 22925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:44.374646 22905 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:43:44.374866 22905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "c9a8fc20401e49d788a2543b2316e350"
format_stamp: "Formatted at 2026-08-07 10:43:44 on dist-test-slave-42z9"
server_key: "d7c7f7317246b80ef30a2b3827e0bb16"
server_key_iv: "f6c9d8ac8e5020700a0031272ad9015e"
server_key_version: "encryptionkey@0"
I20260807 10:43:44.375110 22905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:44.398983 22905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:44.403527 22905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:44.403802 22905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:44.407008 22905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:44.407112 22905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:44.407261 22905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:44.407335 22905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:43:44 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099424, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:44.432802 22936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:44.407487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:37553 (local address 127.11.46.190:36201)
0807 10:43:44.408365 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:44.408371 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:44.409525 (+ 1154us) server_negotiation.cc:407] Connection header received
0807 10:43:44.411846 (+ 2321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:44.411855 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:44.411962 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:44.412098 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:44.414582 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:44.415609 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:44.419147 (+ 3538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:44.419885 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:44.420026 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:44.425126 (+ 5100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:44.425132 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:44.425136 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:44.425180 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:44.428549 (+ 3369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:44.429383 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:44.429389 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:44.429393 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:44.429601 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:44.430327 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:44.430333 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:44.430336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:44.430658 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:44.430830 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:44.432105 (+ 1275us) server_negotiation.cc:299] Negotiation successful
0807 10:43:44.432388 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":709,"thread_start_us":581,"threads_started":1}
I20260807 10:43:44.434783 22938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:44.408279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36201 (local address 127.11.46.129:37553)
0807 10:43:44.409295 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:44.409364 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:44.411478 (+ 2114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:44.412394 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:44.412403 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:44.413266 (+ 863us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:44.414322 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:44.414358 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:44.415861 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:44.415867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:44.418831 (+ 2964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:44.418862 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:44.420310 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:44.420320 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:44.420579 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:44.421469 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:44.421526 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:44.424827 (+ 3301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:44.428716 (+ 3889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:44.428728 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:44.428747 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:44.429235 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:44.429756 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:44.429762 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:44.429766 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:44.430157 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:44.430813 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:44.430823 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:44.431528 (+ 705us) client_negotiation.cc:769] Sending connection context
0807 10:43:44.431947 (+ 419us) client_negotiation.cc:240] Negotiation successful
0807 10:43:44.432711 (+ 764us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":411,"threads_started":1}
I20260807 10:43:44.457892 22936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:44.442294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:57417 (local address 127.11.46.190:36201)
0807 10:43:44.442534 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:44.442540 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:44.443141 (+ 601us) server_negotiation.cc:407] Connection header received
0807 10:43:44.443346 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:44.443350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:44.443440 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:44.443549 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:44.444971 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:44.445733 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:44.447892 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:44.448397 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:44.448507 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:44.451543 (+ 3036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:44.451549 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:44.451553 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:44.451594 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:44.454874 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:44.455684 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:44.455689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:44.455692 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:44.455837 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:44.456237 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:44.456241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:44.456243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:44.456561 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:44.456739 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:44.457194 (+ 455us) server_negotiation.cc:299] Negotiation successful
0807 10:43:44.457503 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 10:43:44.458096 23071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:44.442263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36201 (local address 127.11.46.129:57417)
0807 10:43:44.443004 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:44.443028 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:44.443217 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:44.443586 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:44.443591 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:44.444323 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:44.444803 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:44.444818 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:44.445873 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:44.445879 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:44.447678 (+ 1799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:44.447701 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:44.448629 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:44.448636 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:44.448858 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:44.449787 (+ 929us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:44.449825 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:44.451198 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:44.455053 (+ 3855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:44.455060 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:44.455064 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:44.455543 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:44.455970 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:44.455975 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:44.455978 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:44.456118 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:44.456697 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:44.456702 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:44.456911 (+ 209us) client_negotiation.cc:769] Sending connection context
0807 10:43:44.457047 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 10:43:44.457522 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":377,"threads_started":1}
I20260807 10:43:44.459049 22905 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:37809
I20260807 10:43:44.459074 23103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:37809 every 8 connection(s)
I20260807 10:43:44.461371 22905 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:44.464265 23107 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36201
I20260807 10:43:44.464341 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 22905
I20260807 10:43:44.464540 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:43:44.464597 23107 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:44.465463 11450 external_mini_cluster.cc:1428] Setting key fdeddd1b586c9224d92001120dca913c
I20260807 10:43:44.465682 23107 heartbeater.cc:511] Master 127.11.46.190:36201 requested a full tablet report, sending...
I20260807 10:43:44.468237 22803 ts_manager.cc:194] Registered new tserver with Master: c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809)
I20260807 10:43:44.469964 22803 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:37553
WARNING: no policy specified for oryx/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab.
Entry for principal oryx/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab.
I20260807 10:43:44.532855 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36201
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab
--principal=oryx/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:40181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:44.928030 23112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:44.928366 23112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:44.928520 23112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:44.936542 23112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:44.936688 23112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:44.936825 23112 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:43:44.936949 23112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:44.948256 23112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:40181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab
--principal=oryx/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.46.190:36201
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:44.949923 23112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:44.951678 23112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:44.966840 23121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:44.966745 23125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:44.966713 23118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:44.968026 23112 server_base.cc:1034] running on GCE node
I20260807 10:43:44.968825 23112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:44.970039 23112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:44.971306 23112 hybrid_clock.cc:648] HybridClock initialized: now 1786099424971225 us; error 52 us; skew 500 ppm
I20260807 10:43:44.971652 23112 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:44 dist-test-slave-42z9 krb5kdc[22740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099424, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:44.975157 23112 init.cc:377] Logged in from keytab as oryx/127.11.46.130@KRBTEST.COM (short username oryx)
I20260807 10:43:44.976856 23112 webserver.cc:460] Webserver started at http://127.11.46.130:33151/ using document root <none> and password file <none>
I20260807 10:43:44.977779 23112 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:44.977907 23112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:44.978269 23112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:44.981860 23112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "9910403d86954208840783edf6460af8"
format_stamp: "Formatted at 2026-08-07 10:43:44 on dist-test-slave-42z9"
server_key: "8e1846e9dd1b24283bedab242fb7e9b2"
server_key_iv: "23af089e1a9fd560b7571e539af546b8"
server_key_version: "encryptionkey@0"
I20260807 10:43:44.982867 23112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "9910403d86954208840783edf6460af8"
format_stamp: "Formatted at 2026-08-07 10:43:44 on dist-test-slave-42z9"
server_key: "8e1846e9dd1b24283bedab242fb7e9b2"
server_key_iv: "23af089e1a9fd560b7571e539af546b8"
server_key_version: "encryptionkey@0"
I20260807 10:43:44.989090 23112 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:43:44.994266 23134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:44.996066 23112 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260807 10:43:44.996274 23112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "9910403d86954208840783edf6460af8"
format_stamp: "Formatted at 2026-08-07 10:43:44 on dist-test-slave-42z9"
server_key: "8e1846e9dd1b24283bedab242fb7e9b2"
server_key_iv: "23af089e1a9fd560b7571e539af546b8"
server_key_version: "encryptionkey@0"
I20260807 10:43:44.996559 23112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:45.019518 23112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:45.024392 23112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:45.024708 23112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:45.027958 23112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:45.028081 23112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:45.028215 23112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:45.028275 23112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:43:45 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099424, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:45.059207 23147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:45.028726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:33827 (local address 127.11.46.190:36201)
0807 10:43:45.029400 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:45.029407 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:45.030856 (+ 1449us) server_negotiation.cc:407] Connection header received
0807 10:43:45.033151 (+ 2295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:45.033157 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:45.033266 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:45.033397 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:45.036633 (+ 3236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.037705 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.041573 (+ 3868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.042157 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.042321 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:45.049388 (+ 7067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:45.049399 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:45.049404 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:45.049482 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:45.053543 (+ 4061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:45.055061 (+ 1518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:45.055069 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:45.055073 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:45.055297 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:45.056107 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:45.056113 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:45.056117 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:45.056581 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:45.056761 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:45.058400 (+ 1639us) server_negotiation.cc:299] Negotiation successful
0807 10:43:45.058729 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":390,"threads_started":1}
I20260807 10:43:45.061053 23149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:45.029585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36201 (local address 127.11.46.130:33827)
0807 10:43:45.030613 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:45.030681 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:45.032777 (+ 2096us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:45.033897 (+ 1120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:45.033918 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:45.035044 (+ 1126us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:45.036326 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:45.036368 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.037918 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.037924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:45.041261 (+ 3337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:45.041301 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.043053 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.043072 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:45.043530 (+ 458us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:45.044589 (+ 1059us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:45.044642 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:45.048931 (+ 4289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:45.053823 (+ 4892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:45.053842 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:45.053867 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:45.054835 (+ 968us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:45.055477 (+ 642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:45.055485 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:45.055489 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:45.055872 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:45.056900 (+ 1028us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:45.056910 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:45.057733 (+ 823us) client_negotiation.cc:769] Sending connection context
0807 10:43:45.058219 (+ 486us) client_negotiation.cc:240] Negotiation successful
0807 10:43:45.059026 (+ 807us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"thread_start_us":425,"threads_started":1}
I20260807 10:43:45.073417 23112 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:40221
I20260807 10:43:45.073493 23329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:40221 every 8 connection(s)
I20260807 10:43:45.075426 23112 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:45.078094 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 23112
I20260807 10:43:45.078284 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:43:45.078857 11450 external_mini_cluster.cc:1428] Setting key a4326cc3f7310e0211c7810e059dc398
I20260807 10:43:45.078318 23330 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36201
I20260807 10:43:45.079358 23330 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:45.080499 23330 heartbeater.cc:511] Master 127.11.46.190:36201 requested a full tablet report, sending...
I20260807 10:43:45.082438 22803 ts_manager.cc:194] Registered new tserver with Master: 9910403d86954208840783edf6460af8 (127.11.46.130:40221)
I20260807 10:43:45.083520 22803 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:33827
I20260807 10:43:45.086704 23147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:45.068448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:56419 (local address 127.11.46.190:36201)
0807 10:43:45.068661 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:45.068665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:45.069606 (+ 941us) server_negotiation.cc:407] Connection header received
0807 10:43:45.069966 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:45.069973 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:45.070070 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:45.070151 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:45.071836 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.072981 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.075179 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.075705 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.075834 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:45.079471 (+ 3637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:45.079479 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:45.079485 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:45.079533 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:45.083043 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:45.084117 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:45.084123 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:45.084126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:45.084304 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:45.084812 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:45.084817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:45.084821 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:45.085314 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:45.085519 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:45.086113 (+ 594us) server_negotiation.cc:299] Negotiation successful
0807 10:43:45.086382 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 10:43:45.086822 23314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:45.068478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36201 (local address 127.11.46.130:56419)
0807 10:43:45.069458 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:45.069490 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:45.069767 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:45.070433 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:45.070438 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:45.071231 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:45.071639 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:45.071651 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.073260 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.073266 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:45.074928 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:45.074949 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.075940 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.075948 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:45.076194 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:45.077765 (+ 1571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:45.077794 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:45.079076 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:45.083283 (+ 4207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:45.083290 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:45.083294 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:45.083929 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:45.084451 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:45.084457 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:45.084469 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:45.084663 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:45.085523 (+ 860us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:45.085530 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:45.085751 (+ 221us) client_negotiation.cc:769] Sending connection context
0807 10:43:45.085922 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 10:43:45.086324 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"thread_start_us":456,"threads_started":1}
WARNING: no policy specified for oryx/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab.
Entry for principal oryx/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab.
I20260807 10:43:45.149989 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36201
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab
--principal=oryx/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:40181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:43:45.474035 23107 heartbeater.cc:503] Master 127.11.46.190:36201 was elected leader, sending a full tablet report...
W20260807 10:43:45.545825 23335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:45.546169 23335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:45.546317 23335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:45.554064 23335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:45.554226 23335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:45.554370 23335 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 10:43:45.554487 23335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:45.565330 23335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:40181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab
--principal=oryx/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.46.190:36201
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:45.566927 23335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:45.568482 23335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:45.583786 23344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:45.583838 23347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:45.583922 23343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:45.585165 23335 server_base.cc:1034] running on GCE node
I20260807 10:43:45.586009 23335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:45.587224 23335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:45.588511 23335 hybrid_clock.cc:648] HybridClock initialized: now 1786099425588420 us; error 70 us; skew 500 ppm
I20260807 10:43:45.588855 23335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:45 dist-test-slave-42z9 krb5kdc[22740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099425, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:45.592532 23335 init.cc:377] Logged in from keytab as oryx/127.11.46.131@KRBTEST.COM (short username oryx)
I20260807 10:43:45.594374 23335 webserver.cc:460] Webserver started at http://127.11.46.131:40177/ using document root <none> and password file <none>
I20260807 10:43:45.595155 23335 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:45.595257 23335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:45.595590 23335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:45.598971 23335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "7a3a06667c0941c696c4a2870b8e57dc"
format_stamp: "Formatted at 2026-08-07 10:43:45 on dist-test-slave-42z9"
server_key: "b7bb5866c8a7f0d371a9f798a30679c5"
server_key_iv: "6fe10b1fa83823959748a5e9d11bc356"
server_key_version: "encryptionkey@0"
I20260807 10:43:45.599861 23335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "7a3a06667c0941c696c4a2870b8e57dc"
format_stamp: "Formatted at 2026-08-07 10:43:45 on dist-test-slave-42z9"
server_key: "b7bb5866c8a7f0d371a9f798a30679c5"
server_key_iv: "6fe10b1fa83823959748a5e9d11bc356"
server_key_version: "encryptionkey@0"
I20260807 10:43:45.606148 23335 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 10:43:45.610473 23358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:45.612179 23335 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260807 10:43:45.612409 23335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "7a3a06667c0941c696c4a2870b8e57dc"
format_stamp: "Formatted at 2026-08-07 10:43:45 on dist-test-slave-42z9"
server_key: "b7bb5866c8a7f0d371a9f798a30679c5"
server_key_iv: "6fe10b1fa83823959748a5e9d11bc356"
server_key_version: "encryptionkey@0"
I20260807 10:43:45.612686 23335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:45.640879 23335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:45.645745 23335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:45.646034 23335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:45.649091 23335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:45.649186 23335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:45.649304 23335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:45.649382 23335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:43:45 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099425, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:45.677263 23371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:45.649620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:59319 (local address 127.11.46.190:36201)
0807 10:43:45.650417 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:45.650423 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:45.651564 (+ 1141us) server_negotiation.cc:407] Connection header received
0807 10:43:45.654606 (+ 3042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:45.654612 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:45.654709 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:45.654838 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:45.657527 (+ 2689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.658536 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.661855 (+ 3319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.662507 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.662674 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:45.669505 (+ 6831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:45.669514 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:45.669520 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:45.669563 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:45.673216 (+ 3653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:45.674438 (+ 1222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:45.674445 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:45.674449 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:45.674644 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:45.675220 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:45.675226 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:45.675230 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:45.675594 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:45.675748 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:45.676581 (+ 833us) server_negotiation.cc:299] Negotiation successful
0807 10:43:45.676844 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":544,"threads_started":1}
I20260807 10:43:45.678522 23372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:45.650344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36201 (local address 127.11.46.131:59319)
0807 10:43:45.651340 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:45.651405 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:45.654157 (+ 2752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:45.655240 (+ 1083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:45.655253 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:45.656147 (+ 894us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:45.657173 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:45.657199 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.658785 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.658793 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:45.661596 (+ 2803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:45.661629 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.662856 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.662865 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:45.663286 (+ 421us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:45.664332 (+ 1046us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:45.664383 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:45.669098 (+ 4715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:45.673482 (+ 4384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:45.673498 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:45.673525 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:45.674260 (+ 735us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:45.674761 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:45.674766 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:45.674770 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:45.675038 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:45.675742 (+ 704us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:45.675751 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:45.676172 (+ 421us) client_negotiation.cc:769] Sending connection context
0807 10:43:45.676446 (+ 274us) client_negotiation.cc:240] Negotiation successful
0807 10:43:45.677063 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":384,"threads_started":1}
I20260807 10:43:45.704843 23335 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:43733
I20260807 10:43:45.704855 23539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:43733 every 8 connection(s)
I20260807 10:43:45.706651 23335 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:45.708564 23501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:45.692811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36201 (local address 127.11.46.131:56659)
0807 10:43:45.693512 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:45.693534 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:45.693765 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:45.694176 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:45.694181 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:45.694918 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:45.695341 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:45.695357 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.696683 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.696688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:45.697925 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:45.697946 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.699160 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.699166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:45.699303 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:45.700046 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:45.700077 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:45.701059 (+ 982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:45.705310 (+ 4251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:45.705316 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:45.705319 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:45.705841 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:45.706314 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:45.706317 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:45.706320 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:45.706460 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:45.707133 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:45.707137 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:45.707392 (+ 255us) client_negotiation.cc:769] Sending connection context
0807 10:43:45.707586 (+ 194us) client_negotiation.cc:240] Negotiation successful
0807 10:43:45.708062 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":354,"threads_started":1}
I20260807 10:43:45.708753 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 23335
I20260807 10:43:45.708796 23371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:45.692704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:56659 (local address 127.11.46.190:36201)
0807 10:43:45.692932 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:45.692937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:45.693617 (+ 680us) server_negotiation.cc:407] Connection header received
0807 10:43:45.693932 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:45.693938 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:45.694017 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:45.694101 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:45.695506 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.696523 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.698144 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.698896 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.699064 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:45.701325 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:45.701334 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:45.701339 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:45.701391 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:45.705124 (+ 3733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:45.705990 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:45.705996 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:45.706000 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:45.706185 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:45.706587 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:45.706593 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:45.706595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:45.707010 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:45.707187 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:45.708166 (+ 979us) server_negotiation.cc:299] Negotiation successful
0807 10:43:45.708450 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 10:43:45.708935 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:43:45.709373 11450 external_mini_cluster.cc:1428] Setting key 9d91724ce28ddaf95b83ddb2892c53ef
I20260807 10:43:45.710438 23540 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36201
I20260807 10:43:45.710752 23540 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:45.711669 23540 heartbeater.cc:511] Master 127.11.46.190:36201 requested a full tablet report, sending...
I20260807 10:43:45.713306 22803 ts_manager.cc:194] Registered new tserver with Master: 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733)
I20260807 10:43:45.714208 22803 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:59319
I20260807 10:43:45.725790 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 10:43:45 dist-test-slave-42z9 krb5kdc[22740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099425, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 10:43:45 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:45 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:43:46.087316 23330 heartbeater.cc:503] Master 127.11.46.190:36201 was elected leader, sending a full tablet report...
I20260807 10:43:46.717116 23540 heartbeater.cc:503] Master 127.11.46.190:36201 was elected leader, sending a full tablet report...
W20260807 10:43:46.828581 23552 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.036s user 0.000s sys 0.021s
W20260807 10:43:46.829931 23371 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:45.786209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55570 (local address 127.11.46.190:36201)
0807 10:43:45.786469 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:45.786476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:45.786673 (+ 197us) server_negotiation.cc:407] Connection header received
0807 10:43:45.786831 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:45.786836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:45.786937 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:45.787026 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:45.788386 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.789148 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.790565 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:45.791025 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:45.791158 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.829682 (+1038524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55570: BlockingRecv error: recv got EOF from 127.0.0.1:55570 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 07 10:43:46 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099425, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:46.850029 23371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.834737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55578 (local address 127.11.46.190:36201)
0807 10:43:46.834927 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:46.834932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:46.835295 (+ 363us) server_negotiation.cc:407] Connection header received
0807 10:43:46.835459 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:46.835464 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:46.835543 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:46.835643 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:46.836931 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.837789 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.839285 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.839787 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.839902 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.843944 (+ 4042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:46.843951 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:46.843954 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:46.844009 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:46.846700 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:46.847605 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:46.847614 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:46.847618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:46.847900 (+ 282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:46.848453 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:46.848461 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:46.848464 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:46.848849 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:46.849099 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:46.849537 (+ 438us) server_negotiation.cc:299] Negotiation successful
0807 10:43:46.849762 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:43:46.854904 22803 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:43:46.862473 22803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:43:46.889483 23569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.876599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:43733 (local address 127.0.0.1:52734)
0807 10:43:46.878507 (+ 1908us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:46.878527 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:46.878641 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:46.879831 (+ 1190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:46.879835 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:46.879876 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:46.880462 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:46.880476 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.883278 (+ 2802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.883284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:46.885936 (+ 2652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:46.885958 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.888221 (+ 2263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.888229 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:46.888451 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.888520 (+ 69us) client_negotiation.cc:769] Sending connection context
0807 10:43:46.888650 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 10:43:46.888871 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1777,"mutex_wait_us":50,"spinlock_wait_cycles":9984,"thread_start_us":1599,"threads_started":1}
I20260807 10:43:46.891366 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.877331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52734 (local address 127.11.46.131:43733)
0807 10:43:46.879227 (+ 1896us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:46.879235 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:46.879262 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:43:46.879380 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:46.879388 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:46.879615 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:46.881205 (+ 1590us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:46.881468 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.883094 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.886266 (+ 3172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.887926 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.890355 (+ 2429us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.890721 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:46.890817 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 10:43:46.891040 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1659,"thread_start_us":1530,"threads_started":1}
I20260807 10:43:46.892122 23566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.876235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:40221 (local address 127.0.0.1:39136)
0807 10:43:46.877792 (+ 1557us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:46.877835 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:46.878056 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:46.879813 (+ 1757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:46.879821 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:46.879867 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:46.880952 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:46.880965 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.883315 (+ 2350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.883320 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:46.887131 (+ 3811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:46.887151 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.891139 (+ 3988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.891146 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:46.891353 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.891392 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 10:43:46.891499 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 10:43:46.891676 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1267,"mutex_wait_us":461,"spinlock_wait_cycles":384,"thread_start_us":1090,"threads_started":1}
I20260807 10:43:46.892154 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.876480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39136 (local address 127.11.46.130:40221)
0807 10:43:46.878727 (+ 2247us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:46.878737 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:46.878770 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:43:46.878894 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:46.878902 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:46.879210 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:46.879520 (+ 310us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:46.881311 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.883170 (+ 1859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.887388 (+ 4218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.890874 (+ 3486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.891031 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.891247 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:46.891674 (+ 427us) server_negotiation.cc:299] Negotiation successful
0807 10:43:46.891868 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2073,"thread_start_us":1933,"threads_started":1}
I20260807 10:43:46.896106 23436 tablet_service.cc:1467] Processing CreateTablet for tablet 31c27a176c74410b9a6547d86584d1f6 (DEFAULT_TABLE table=test-table [id=09475e5350d8436083689b9e80ae5218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:46.896106 23221 tablet_service.cc:1467] Processing CreateTablet for tablet 31c27a176c74410b9a6547d86584d1f6 (DEFAULT_TABLE table=test-table [id=09475e5350d8436083689b9e80ae5218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:46.897941 23436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31c27a176c74410b9a6547d86584d1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:46.898002 23221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31c27a176c74410b9a6547d86584d1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:46.898624 23571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.879447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37809 (local address 127.0.0.1:40452)
0807 10:43:46.889815 (+ 10368us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:46.889847 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:46.890000 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:46.891359 (+ 1359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:46.891365 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:46.891397 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:46.891846 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:46.891862 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.894367 (+ 2505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.894373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:46.896150 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:46.896166 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.897770 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.897778 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:46.897978 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.898008 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:43:46.898107 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 10:43:46.898258 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10195,"thread_start_us":9926,"threads_started":1}
I20260807 10:43:46.898877 23572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.880093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40452 (local address 127.11.46.129:37809)
0807 10:43:46.890631 (+ 10538us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:46.890640 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:46.890704 (+ 64us) server_negotiation.cc:407] Connection header received
0807 10:43:46.890824 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:46.890831 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:46.891109 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:46.891343 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:46.892091 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.894156 (+ 2065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.896350 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.897522 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.897677 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.897917 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:46.898242 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 10:43:46.898463 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10319,"thread_start_us":10141,"threads_started":1}
I20260807 10:43:46.902956 23001 tablet_service.cc:1467] Processing CreateTablet for tablet 31c27a176c74410b9a6547d86584d1f6 (DEFAULT_TABLE table=test-table [id=09475e5350d8436083689b9e80ae5218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:46.905074 23001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31c27a176c74410b9a6547d86584d1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:46.914911 23573 tablet_bootstrap.cc:492] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: Bootstrap starting.
I20260807 10:43:46.917960 23574 tablet_bootstrap.cc:492] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: Bootstrap starting.
I20260807 10:43:46.919673 23573 tablet_bootstrap.cc:654] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:46.919679 23575 tablet_bootstrap.cc:492] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: Bootstrap starting.
I20260807 10:43:46.921828 23573 log.cc:824] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:46.923885 23575 tablet_bootstrap.cc:654] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:46.923933 23574 tablet_bootstrap.cc:654] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:46.925498 23574 log.cc:824] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:46.925514 23575 log.cc:824] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:46.927186 23573 tablet_bootstrap.cc:492] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: No bootstrap required, opened a new log
I20260807 10:43:46.927563 23573 ts_tablet_manager.cc:1397] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260807 10:43:46.928658 23575 tablet_bootstrap.cc:492] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: No bootstrap required, opened a new log
I20260807 10:43:46.928947 23575 ts_tablet_manager.cc:1397] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260807 10:43:46.928998 23574 tablet_bootstrap.cc:492] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: No bootstrap required, opened a new log
I20260807 10:43:46.929283 23574 ts_tablet_manager.cc:1397] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20260807 10:43:46.937505 23575 raft_consensus.cc:348] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } }
I20260807 10:43:46.938042 23575 raft_consensus.cc:374] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:46.938192 23575 raft_consensus.cc:729] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a8fc20401e49d788a2543b2316e350, State: Initialized, Role: FOLLOWER
I20260807 10:43:46.939019 23575 consensus_queue.cc:260] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } }
I20260807 10:43:46.939111 23573 raft_consensus.cc:348] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } }
I20260807 10:43:46.939726 23573 raft_consensus.cc:374] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:46.939904 23573 raft_consensus.cc:729] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3a06667c0941c696c4a2870b8e57dc, State: Initialized, Role: FOLLOWER
I20260807 10:43:46.940503 23574 raft_consensus.cc:348] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } }
I20260807 10:43:46.941023 23574 raft_consensus.cc:374] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:46.940801 23573 consensus_queue.cc:260] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } }
I20260807 10:43:46.941167 23574 raft_consensus.cc:729] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9910403d86954208840783edf6460af8, State: Initialized, Role: FOLLOWER
I20260807 10:43:46.941169 23575 ts_tablet_manager.cc:1428] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260807 10:43:46.941932 23574 consensus_queue.cc:260] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } }
I20260807 10:43:46.944041 23574 ts_tablet_manager.cc:1428] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260807 10:43:46.945365 23573 ts_tablet_manager.cc:1428] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: Time spent starting tablet: real 0.018s user 0.011s sys 0.005s
W20260807 10:43:46.959661 23541 tablet.cc:2369] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:46.960242 23579 raft_consensus.cc:482] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:43:46.960546 23579 raft_consensus.cc:504] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } }
I20260807 10:43:46.962836 23579 leader_election.cc:288] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9910403d86954208840783edf6460af8 (127.11.46.130:40221), 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733)
W20260807 10:43:46.965682 23108 tablet.cc:2369] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:46.970359 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.963324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:47509 (local address 127.11.46.131:43733)
0807 10:43:46.963628 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:46.963634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:46.964218 (+ 584us) server_negotiation.cc:407] Connection header received
0807 10:43:46.964455 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:46.964459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:46.964528 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:46.964618 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:46.965174 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.966256 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.968409 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.969252 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.969411 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.969525 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:46.969951 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 10:43:46.970104 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260807 10:43:46.970358 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.963404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:50565 (local address 127.11.46.130:40221)
0807 10:43:46.963714 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:46.963721 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:46.964201 (+ 480us) server_negotiation.cc:407] Connection header received
0807 10:43:46.964800 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:46.964804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:46.964868 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:46.964948 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:46.965620 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.966674 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.968487 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.969298 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.969494 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.969580 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:46.969939 (+ 359us) server_negotiation.cc:299] Negotiation successful
0807 10:43:46.970100 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260807 10:43:46.970588 23587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.963183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:40221 (local address 127.11.46.129:50565)
0807 10:43:46.964072 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:46.964099 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:46.964282 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:46.965008 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:46.965013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:46.965045 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:46.965422 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:46.965459 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.966843 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.966847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:46.968307 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:46.968325 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.969591 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.969598 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:46.969753 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.969795 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 10:43:46.969883 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 10:43:46.970105 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"mutex_wait_us":49,"thread_start_us":719,"threads_started":1}
I20260807 10:43:46.970628 23589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:46.963231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:43733 (local address 127.11.46.129:47509)
0807 10:43:46.964131 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:46.964145 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:46.964298 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:46.964669 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:46.964673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:46.964696 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:46.965006 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:46.965016 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.966437 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.966444 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:46.968206 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:46.968223 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:46.969556 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:46.969564 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:46.969766 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:46.969808 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 10:43:46.969898 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 10:43:46.970088 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"mutex_wait_us":65,"thread_start_us":583,"threads_started":1}
I20260807 10:43:46.971850 23460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31c27a176c74410b9a6547d86584d1f6" candidate_uuid: "c9a8fc20401e49d788a2543b2316e350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3a06667c0941c696c4a2870b8e57dc" is_pre_election: true
I20260807 10:43:46.971840 23249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31c27a176c74410b9a6547d86584d1f6" candidate_uuid: "c9a8fc20401e49d788a2543b2316e350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9910403d86954208840783edf6460af8" is_pre_election: true
I20260807 10:43:46.972493 23460 raft_consensus.cc:2454] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a8fc20401e49d788a2543b2316e350 in term 0.
I20260807 10:43:46.972493 23249 raft_consensus.cc:2454] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a8fc20401e49d788a2543b2316e350 in term 0.
I20260807 10:43:46.973292 22930 leader_election.cc:302] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9910403d86954208840783edf6460af8, c9a8fc20401e49d788a2543b2316e350; no voters:
I20260807 10:43:46.973830 23579 raft_consensus.cc:2781] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:43:46.973979 23579 raft_consensus.cc:482] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:43:46.974092 23579 raft_consensus.cc:3037] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:46.976490 23579 raft_consensus.cc:504] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } }
I20260807 10:43:46.977262 23579 leader_election.cc:288] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [CANDIDATE]: Term 1 election: Requested vote from peers 9910403d86954208840783edf6460af8 (127.11.46.130:40221), 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733)
I20260807 10:43:46.978030 23460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31c27a176c74410b9a6547d86584d1f6" candidate_uuid: "c9a8fc20401e49d788a2543b2316e350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3a06667c0941c696c4a2870b8e57dc"
I20260807 10:43:46.978030 23249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31c27a176c74410b9a6547d86584d1f6" candidate_uuid: "c9a8fc20401e49d788a2543b2316e350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9910403d86954208840783edf6460af8"
I20260807 10:43:46.978312 23249 raft_consensus.cc:3037] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:46.978310 23460 raft_consensus.cc:3037] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:46.982040 23249 raft_consensus.cc:2454] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a8fc20401e49d788a2543b2316e350 in term 1.
I20260807 10:43:46.982039 23460 raft_consensus.cc:2454] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a8fc20401e49d788a2543b2316e350 in term 1.
I20260807 10:43:46.982702 22928 leader_election.cc:302] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3a06667c0941c696c4a2870b8e57dc, c9a8fc20401e49d788a2543b2316e350; no voters:
I20260807 10:43:46.983114 23579 raft_consensus.cc:2781] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:46.983633 23579 raft_consensus.cc:686] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 1 LEADER]: Becoming Leader. State: Replica: c9a8fc20401e49d788a2543b2316e350, State: Running, Role: LEADER
I20260807 10:43:46.984222 23579 consensus_queue.cc:237] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } }
I20260807 10:43:46.989178 22803 catalog_manager.cc:5495] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a8fc20401e49d788a2543b2316e350 (127.11.46.129). New cstate: current_term: 1 leader_uuid: "c9a8fc20401e49d788a2543b2316e350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } health_report { overall_health: HEALTHY } } }
I20260807 10:43:47.020905 23572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.014972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40462 (local address 127.11.46.129:37809)
0807 10:43:47.015320 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.015325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.015346 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:43:47.015454 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.015459 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.015563 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.015718 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:47.016134 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.016993 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.018457 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.018892 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.019019 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.019587 (+ 568us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:47.020233 (+ 646us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:47.020383 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.020506 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.020619 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260807 10:43:47.031982 23460 raft_consensus.cc:1261] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Refusing update from remote peer c9a8fc20401e49d788a2543b2316e350: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:47.031972 23249 raft_consensus.cc:1261] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Refusing update from remote peer c9a8fc20401e49d788a2543b2316e350: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:47.033169 23590 consensus_queue.cc:1035] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:47.033720 23579 consensus_queue.cc:1035] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:47.048557 23595 mvcc.cc:205] Tried to move back new op lower bound from 7315863253110767616 to 7315863252931637248. Current Snapshot: MvccSnapshot[applied={T|T < 7315863253110767616}]
I20260807 10:43:47.064083 22805 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:47.064361 22805 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:47.068675 22805 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716: Sending DeleteTablet for 3 replicas of tablet 31c27a176c74410b9a6547d86584d1f6
I20260807 10:43:47.070106 23221 tablet_service.cc:1514] Processing DeleteTablet for tablet 31c27a176c74410b9a6547d86584d1f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:47 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:39136
I20260807 10:43:47.070258 23436 tablet_service.cc:1514] Processing DeleteTablet for tablet 31c27a176c74410b9a6547d86584d1f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:47 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:52734
I20260807 10:43:47.070497 23001 tablet_service.cc:1514] Processing DeleteTablet for tablet 31c27a176c74410b9a6547d86584d1f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:47 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:40452
I20260807 10:43:47.071267 23609 tablet_replica.cc:330] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: stopping tablet replica
I20260807 10:43:47.071833 23609 raft_consensus.cc:2229] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:47.072480 23609 raft_consensus.cc:2258] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:47.072664 22803 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 10:43:47.073019 23612 tablet_replica.cc:330] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: stopping tablet replica
I20260807 10:43:47.073499 23611 tablet_replica.cc:330] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: stopping tablet replica
W20260807 10:43:47.073501 22803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:43:47.073523 23612 raft_consensus.cc:2229] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:43:47.073927 23611 raft_consensus.cc:2229] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:47.074337 23612 raft_consensus.cc:2258] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:47.074491 23611 raft_consensus.cc:2258] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:47.076843 23611 ts_tablet_manager.cc:1905] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:47.084156 23001 tablet_service.cc:1467] Processing CreateTablet for tablet 9664889f75f7487e8b6ba833706fe70c (DEFAULT_TABLE table=test-table [id=81592b6374074f46a4e4205d1d8254ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:47.084767 23001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9664889f75f7487e8b6ba833706fe70c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:47.085731 23611 ts_tablet_manager.cc:1918] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:47.085933 23611 log.cc:1196] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/31c27a176c74410b9a6547d86584d1f6
I20260807 10:43:47.086535 23611 ts_tablet_manager.cc:1939] T 31c27a176c74410b9a6547d86584d1f6 P 7a3a06667c0941c696c4a2870b8e57dc: Deleting consensus metadata
I20260807 10:43:47.088966 22786 catalog_manager.cc:4841] TS 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733): tablet 31c27a176c74410b9a6547d86584d1f6 (table test-table [id=09475e5350d8436083689b9e80ae5218]) successfully deleted
I20260807 10:43:47.090183 23436 tablet_service.cc:1467] Processing CreateTablet for tablet 9664889f75f7487e8b6ba833706fe70c (DEFAULT_TABLE table=test-table [id=81592b6374074f46a4e4205d1d8254ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:47.090224 23221 tablet_service.cc:1467] Processing CreateTablet for tablet 9664889f75f7487e8b6ba833706fe70c (DEFAULT_TABLE table=test-table [id=81592b6374074f46a4e4205d1d8254ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:47.090741 23436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9664889f75f7487e8b6ba833706fe70c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:47.090770 23221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9664889f75f7487e8b6ba833706fe70c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:47.092906 23575 tablet_bootstrap.cc:492] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350: Bootstrap starting.
I20260807 10:43:47.094959 23575 tablet_bootstrap.cc:654] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:47.098249 23574 tablet_bootstrap.cc:492] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8: Bootstrap starting.
I20260807 10:43:47.098794 23573 tablet_bootstrap.cc:492] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc: Bootstrap starting.
I20260807 10:43:47.100252 23574 tablet_bootstrap.cc:654] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:47.100754 23573 tablet_bootstrap.cc:654] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:47.104732 23573 tablet_bootstrap.cc:492] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc: No bootstrap required, opened a new log
I20260807 10:43:47.104923 23573 ts_tablet_manager.cc:1397] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260807 10:43:47.105846 23573 raft_consensus.cc:348] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.106105 23573 raft_consensus.cc:374] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:47.106190 23573 raft_consensus.cc:729] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3a06667c0941c696c4a2870b8e57dc, State: Initialized, Role: FOLLOWER
I20260807 10:43:47.106498 23573 consensus_queue.cc:260] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.107262 23573 ts_tablet_manager.cc:1428] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 10:43:47.108500 23609 ts_tablet_manager.cc:1905] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:47.118055 23574 tablet_bootstrap.cc:492] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8: No bootstrap required, opened a new log
I20260807 10:43:47.118285 23574 ts_tablet_manager.cc:1397] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.000s
I20260807 10:43:47.119230 23574 raft_consensus.cc:348] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.119509 23574 raft_consensus.cc:374] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:47.119616 23574 raft_consensus.cc:729] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9910403d86954208840783edf6460af8, State: Initialized, Role: FOLLOWER
I20260807 10:43:47.119979 23574 consensus_queue.cc:260] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.120633 23574 ts_tablet_manager.cc:1428] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 10:43:47.120927 23609 ts_tablet_manager.cc:1918] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:47.121192 23609 log.cc:1196] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/31c27a176c74410b9a6547d86584d1f6
I20260807 10:43:47.122334 23609 ts_tablet_manager.cc:1939] T 31c27a176c74410b9a6547d86584d1f6 P 9910403d86954208840783edf6460af8: Deleting consensus metadata
I20260807 10:43:47.124570 22788 catalog_manager.cc:4841] TS 9910403d86954208840783edf6460af8 (127.11.46.130:40221): tablet 31c27a176c74410b9a6547d86584d1f6 (table test-table [id=09475e5350d8436083689b9e80ae5218]) successfully deleted
I20260807 10:43:47.126446 23612 ts_tablet_manager.cc:1905] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:47.133826 23575 tablet_bootstrap.cc:492] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350: No bootstrap required, opened a new log
I20260807 10:43:47.134171 23575 ts_tablet_manager.cc:1397] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350: Time spent bootstrapping tablet: real 0.041s user 0.014s sys 0.019s
I20260807 10:43:47.135363 23575 raft_consensus.cc:348] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.135727 23575 raft_consensus.cc:374] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:47.135896 23575 raft_consensus.cc:729] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a8fc20401e49d788a2543b2316e350, State: Initialized, Role: FOLLOWER
I20260807 10:43:47.136322 23575 consensus_queue.cc:260] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.137096 23575 ts_tablet_manager.cc:1428] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 10:43:47.139328 23612 ts_tablet_manager.cc:1918] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:47.139655 23612 log.cc:1196] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/31c27a176c74410b9a6547d86584d1f6
I20260807 10:43:47.140442 23612 ts_tablet_manager.cc:1939] T 31c27a176c74410b9a6547d86584d1f6 P c9a8fc20401e49d788a2543b2316e350: Deleting consensus metadata
I20260807 10:43:47.142620 22788 catalog_manager.cc:4841] TS c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809): tablet 31c27a176c74410b9a6547d86584d1f6 (table test-table [id=09475e5350d8436083689b9e80ae5218]) successfully deleted
I20260807 10:43:47.183245 23580 raft_consensus.cc:482] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:43:47.183521 23580 raft_consensus.cc:504] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.185262 23580 leader_election.cc:288] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809), 9910403d86954208840783edf6460af8 (127.11.46.130:40221)
I20260807 10:43:47.193523 23618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.185715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37809 (local address 127.11.46.131:49403)
0807 10:43:47.186657 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:47.186674 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:47.186837 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:47.187460 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:47.187466 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:47.187499 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:47.187938 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.187955 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.189578 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.189584 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.191295 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.191310 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.192595 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.192602 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.192801 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.192839 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 10:43:47.192943 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 10:43:47.193108 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"thread_start_us":622,"threads_started":1}
I20260807 10:43:47.193536 23572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.186055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:49403 (local address 127.11.46.129:37809)
0807 10:43:47.186367 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.186375 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.186776 (+ 401us) server_negotiation.cc:407] Connection header received
0807 10:43:47.187040 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.187046 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.187131 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.187200 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:47.188136 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.189382 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.191477 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.192372 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.192550 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.192651 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.192994 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.193149 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260807 10:43:47.194680 23030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9664889f75f7487e8b6ba833706fe70c" candidate_uuid: "7a3a06667c0941c696c4a2870b8e57dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a8fc20401e49d788a2543b2316e350" is_pre_election: true
I20260807 10:43:47.195055 23619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.186839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:40221 (local address 127.11.46.131:39493)
0807 10:43:47.187850 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:47.187870 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:47.188025 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:47.188426 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:47.188430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:47.188458 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:47.188775 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.188786 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.190035 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.190040 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.192201 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.192218 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.194318 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.194323 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.194459 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.194484 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 10:43:47.194574 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 10:43:47.194723 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":871,"thread_start_us":612,"threads_started":1}
I20260807 10:43:47.195055 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.187098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:39493 (local address 127.11.46.130:40221)
0807 10:43:47.187291 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.187297 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.187997 (+ 700us) server_negotiation.cc:407] Connection header received
0807 10:43:47.188229 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.188234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.188308 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.188385 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:47.188931 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.189881 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.192407 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.193592 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.193995 (+ 403us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.194075 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.194633 (+ 558us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.194780 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:43:47.195245 23030 raft_consensus.cc:2454] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3a06667c0941c696c4a2870b8e57dc in term 0.
I20260807 10:43:47.195719 23249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9664889f75f7487e8b6ba833706fe70c" candidate_uuid: "7a3a06667c0941c696c4a2870b8e57dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9910403d86954208840783edf6460af8" is_pre_election: true
I20260807 10:43:47.195988 23249 raft_consensus.cc:2454] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a3a06667c0941c696c4a2870b8e57dc in term 0.
I20260807 10:43:47.196036 23364 leader_election.cc:302] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3a06667c0941c696c4a2870b8e57dc, c9a8fc20401e49d788a2543b2316e350; no voters:
I20260807 10:43:47.196528 23580 raft_consensus.cc:2781] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:43:47.196676 23580 raft_consensus.cc:482] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:43:47.196785 23580 raft_consensus.cc:3037] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:47.199465 23580 raft_consensus.cc:504] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.200119 23580 leader_election.cc:288] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [CANDIDATE]: Term 1 election: Requested vote from peers c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809), 9910403d86954208840783edf6460af8 (127.11.46.130:40221)
I20260807 10:43:47.200707 23030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9664889f75f7487e8b6ba833706fe70c" candidate_uuid: "7a3a06667c0941c696c4a2870b8e57dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a8fc20401e49d788a2543b2316e350"
I20260807 10:43:47.200939 23030 raft_consensus.cc:3037] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:47.200860 23249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9664889f75f7487e8b6ba833706fe70c" candidate_uuid: "7a3a06667c0941c696c4a2870b8e57dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9910403d86954208840783edf6460af8"
I20260807 10:43:47.201124 23249 raft_consensus.cc:3037] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:47.203493 23030 raft_consensus.cc:2454] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3a06667c0941c696c4a2870b8e57dc in term 1.
I20260807 10:43:47.204000 23364 leader_election.cc:302] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3a06667c0941c696c4a2870b8e57dc, c9a8fc20401e49d788a2543b2316e350; no voters:
I20260807 10:43:47.204324 23580 raft_consensus.cc:2781] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:47.204321 23249 raft_consensus.cc:2454] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a3a06667c0941c696c4a2870b8e57dc in term 1.
I20260807 10:43:47.205161 23580 raft_consensus.cc:686] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 1 LEADER]: Becoming Leader. State: Replica: 7a3a06667c0941c696c4a2870b8e57dc, State: Running, Role: LEADER
I20260807 10:43:47.205646 23580 consensus_queue.cc:237] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.209684 22805 catalog_manager.cc:5495] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131). New cstate: current_term: 1 leader_uuid: "7a3a06667c0941c696c4a2870b8e57dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } health_report { overall_health: HEALTHY } } }
Aug 07 10:43:47 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099423, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.190@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:47.269200 23371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.252266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55580 (local address 127.11.46.190:36201)
0807 10:43:47.252501 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.252506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.253177 (+ 671us) server_negotiation.cc:407] Connection header received
0807 10:43:47.253370 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.253374 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.253475 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.253573 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:47.255280 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.256044 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.258016 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.258429 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.258544 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.263191 (+ 4647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:47.263200 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:47.263205 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:47.263249 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:47.266121 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:47.267130 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:47.267134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:47.267136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:47.267263 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:47.267690 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:47.267693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:47.267695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:47.267991 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:47.268105 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.268670 (+ 565us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.268892 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":83}
I20260807 10:43:47.269595 23633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.252283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36201 (local address 127.0.0.1:55580)
0807 10:43:47.253040 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:47.253066 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:47.253253 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:47.253645 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:47.253650 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:47.254703 (+ 1053us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:47.255084 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.255100 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.256193 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.256199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.257853 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.257873 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.258640 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.258647 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.258832 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.259688 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:47.259715 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:47.262878 (+ 3163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:47.266299 (+ 3421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:47.266320 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:47.266330 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:47.267002 (+ 672us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:47.267368 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:47.267373 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:47.267377 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:47.267573 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:47.268125 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:47.268136 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:47.268372 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 10:43:47.268574 (+ 202us) client_negotiation.cc:240] Negotiation successful
0807 10:43:47.269081 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":135,"thread_start_us":394,"threads_started":1}
I20260807 10:43:47.275621 22805 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:55580:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 10:43:47.276773 22805 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:43:47.286638 23436 tablet_service.cc:1467] Processing CreateTablet for tablet 6863777655054f778d495c28f93e77c7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0c386baa39df493eb937a10e65b68fec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:43:47.286530 23221 tablet_service.cc:1467] Processing CreateTablet for tablet 6863777655054f778d495c28f93e77c7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0c386baa39df493eb937a10e65b68fec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:43:47.287382 23436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6863777655054f778d495c28f93e77c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:47.287563 23221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6863777655054f778d495c28f93e77c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:47.294111 23001 tablet_service.cc:1467] Processing CreateTablet for tablet 6863777655054f778d495c28f93e77c7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0c386baa39df493eb937a10e65b68fec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 10:43:47.294813 23001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6863777655054f778d495c28f93e77c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:47.296213 23574 tablet_bootstrap.cc:492] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: Bootstrap starting.
I20260807 10:43:47.297304 23573 tablet_bootstrap.cc:492] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: Bootstrap starting.
I20260807 10:43:47.298139 23574 tablet_bootstrap.cc:654] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:47.299126 23573 tablet_bootstrap.cc:654] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:47.303637 23575 tablet_bootstrap.cc:492] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: Bootstrap starting.
I20260807 10:43:47.305904 23575 tablet_bootstrap.cc:654] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:47.309928 23573 tablet_bootstrap.cc:492] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: No bootstrap required, opened a new log
I20260807 10:43:47.310254 23573 ts_tablet_manager.cc:1397] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.007s
I20260807 10:43:47.311247 23573 raft_consensus.cc:348] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.311650 23573 raft_consensus.cc:374] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:47.311780 23573 raft_consensus.cc:729] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3a06667c0941c696c4a2870b8e57dc, State: Initialized, Role: FOLLOWER
I20260807 10:43:47.312175 23573 consensus_queue.cc:260] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.312763 23580 tablet_replica.cc:439] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } }
I20260807 10:43:47.312966 23573 ts_tablet_manager.cc:1428] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 10:43:47.313131 23580 tablet_replica.cc:442] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:43:47.316844 23574 tablet_bootstrap.cc:492] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: No bootstrap required, opened a new log
I20260807 10:43:47.317097 23575 tablet_bootstrap.cc:492] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: No bootstrap required, opened a new log
I20260807 10:43:47.317466 23574 ts_tablet_manager.cc:1397] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.004s
I20260807 10:43:47.317307 23575 ts_tablet_manager.cc:1397] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.005s
I20260807 10:43:47.318328 23574 raft_consensus.cc:348] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.318559 23574 raft_consensus.cc:374] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:47.318653 23574 raft_consensus.cc:729] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9910403d86954208840783edf6460af8, State: Initialized, Role: FOLLOWER
I20260807 10:43:47.318737 23575 raft_consensus.cc:348] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.319029 23575 raft_consensus.cc:374] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:47.318921 23574 consensus_queue.cc:260] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.319126 23575 raft_consensus.cc:729] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a8fc20401e49d788a2543b2316e350, State: Initialized, Role: FOLLOWER
I20260807 10:43:47.319648 23574 ts_tablet_manager.cc:1428] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 10:43:47.319521 23575 consensus_queue.cc:260] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.319500 23585 tablet_replica.cc:439] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } }
I20260807 10:43:47.319919 23585 tablet_replica.cc:442] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:43:47.320206 23579 tablet_replica.cc:439] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } }
I20260807 10:43:47.320406 23575 ts_tablet_manager.cc:1428] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260807 10:43:47.320520 23579 tablet_replica.cc:442] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 10:43:47.329612 23332 tablet.cc:2369] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:43:47.449699 23585 raft_consensus.cc:482] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:43:47.449998 23585 raft_consensus.cc:504] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.452356 23585 leader_election.cc:288] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809), 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733)
I20260807 10:43:47.461856 23572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.453116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:35931 (local address 127.11.46.129:37809)
0807 10:43:47.453345 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.453351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.453569 (+ 218us) server_negotiation.cc:407] Connection header received
0807 10:43:47.453816 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.453822 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.453905 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.454039 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:47.454794 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.455947 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.458983 (+ 3036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.460436 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.460604 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.460687 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.461312 (+ 625us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.461505 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 10:43:47.462383 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.452713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:42399 (local address 127.11.46.131:43733)
0807 10:43:47.452905 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.452911 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.454395 (+ 1484us) server_negotiation.cc:407] Connection header received
0807 10:43:47.454546 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.454551 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.454637 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.454742 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:43:47.455367 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.456483 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.459253 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.460598 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.460766 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.460850 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.461924 (+ 1074us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.462101 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:43:47.463169 23638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.453495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:43733 (local address 127.11.46.130:42399)
0807 10:43:47.454262 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:47.454279 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:47.454416 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:47.454793 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:47.454797 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:47.454822 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:47.455184 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.455196 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.456684 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.456690 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.459020 (+ 2330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.459040 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.461495 (+ 2455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.461502 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.461697 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.461736 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 10:43:47.462602 (+ 866us) client_negotiation.cc:240] Negotiation successful
0807 10:43:47.462768 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":410,"threads_started":1}
I20260807 10:43:47.463851 23637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.452688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37809 (local address 127.11.46.130:35931)
0807 10:43:47.453418 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:47.453463 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:47.453641 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:47.454163 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:47.454167 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:47.454195 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:43:47.454608 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.454620 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.456122 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.456127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.458773 (+ 2646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.458792 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.460901 (+ 2109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.460907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.461103 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.461137 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 10:43:47.462380 (+ 1243us) client_negotiation.cc:240] Negotiation successful
0807 10:43:47.462778 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":1,"thread_start_us":410,"threads_started":1}
I20260807 10:43:47.464043 23460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6863777655054f778d495c28f93e77c7" candidate_uuid: "9910403d86954208840783edf6460af8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3a06667c0941c696c4a2870b8e57dc" is_pre_election: true
I20260807 10:43:47.464345 23460 raft_consensus.cc:2454] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9910403d86954208840783edf6460af8 in term 0.
I20260807 10:43:47.464906 23030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6863777655054f778d495c28f93e77c7" candidate_uuid: "9910403d86954208840783edf6460af8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a8fc20401e49d788a2543b2316e350" is_pre_election: true
I20260807 10:43:47.465124 23139 leader_election.cc:302] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3a06667c0941c696c4a2870b8e57dc, 9910403d86954208840783edf6460af8; no voters:
I20260807 10:43:47.465226 23030 raft_consensus.cc:2454] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9910403d86954208840783edf6460af8 in term 0.
I20260807 10:43:47.465649 23585 raft_consensus.cc:2781] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:43:47.465785 23585 raft_consensus.cc:482] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:43:47.465884 23585 raft_consensus.cc:3037] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:47.468417 23585 raft_consensus.cc:504] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.469091 23585 leader_election.cc:288] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [CANDIDATE]: Term 1 election: Requested vote from peers c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809), 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733)
I20260807 10:43:47.469813 23030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6863777655054f778d495c28f93e77c7" candidate_uuid: "9910403d86954208840783edf6460af8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a8fc20401e49d788a2543b2316e350"
I20260807 10:43:47.469839 23460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6863777655054f778d495c28f93e77c7" candidate_uuid: "9910403d86954208840783edf6460af8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3a06667c0941c696c4a2870b8e57dc"
I20260807 10:43:47.470072 23460 raft_consensus.cc:3037] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:47.470111 23030 raft_consensus.cc:3037] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:47.473240 23460 raft_consensus.cc:2454] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9910403d86954208840783edf6460af8 in term 1.
I20260807 10:43:47.473330 23030 raft_consensus.cc:2454] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9910403d86954208840783edf6460af8 in term 1.
I20260807 10:43:47.474097 23141 leader_election.cc:302] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9910403d86954208840783edf6460af8, c9a8fc20401e49d788a2543b2316e350; no voters:
I20260807 10:43:47.474511 23585 raft_consensus.cc:2781] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:47.475008 23585 raft_consensus.cc:686] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [term 1 LEADER]: Becoming Leader. State: Replica: 9910403d86954208840783edf6460af8, State: Running, Role: LEADER
I20260807 10:43:47.475661 23585 consensus_queue.cc:237] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.477767 23639 tablet_replica.cc:439] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: TxnStatusTablet state changed. Reason: New leader 9910403d86954208840783edf6460af8. Latest consensus state: current_term: 1 leader_uuid: "9910403d86954208840783edf6460af8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } }
I20260807 10:43:47.478178 23639 tablet_replica.cc:442] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:43:47.481056 23643 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 10:43:47.481387 23643 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 10:43:47.481355 22802 catalog_manager.cc:5495] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9910403d86954208840783edf6460af8 (127.11.46.130). New cstate: current_term: 1 leader_uuid: "9910403d86954208840783edf6460af8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } health_report { overall_health: UNKNOWN } } }
I20260807 10:43:47.519603 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.511725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39150 (local address 127.11.46.130:40221)
0807 10:43:47.511921 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.511927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.512105 (+ 178us) server_negotiation.cc:407] Connection header received
0807 10:43:47.512407 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.512413 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.512565 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.512730 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:47.513162 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.514412 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.516439 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.517194 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.517334 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.518013 (+ 679us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:47.518841 (+ 828us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:47.518994 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.519111 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.519217 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:43:47.519614 23633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.511632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:40221 (local address 127.0.0.1:39150)
0807 10:43:47.512000 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:47.512020 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:47.512184 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:47.512772 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:47.512777 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:47.512791 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:43:47.513013 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.513023 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.514608 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.514614 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.516236 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.516256 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.517380 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.517386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.517684 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.517793 (+ 109us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:43:47.518973 (+ 1180us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:43:47.518998 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 10:43:47.519086 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 10:43:47.519264 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200}
I20260807 10:43:47.525082 23460 raft_consensus.cc:1261] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Refusing update from remote peer 9910403d86954208840783edf6460af8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:47.526319 23030 raft_consensus.cc:1261] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Refusing update from remote peer 9910403d86954208840783edf6460af8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:47.526912 23585 consensus_queue.cc:1035] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:47.527314 23639 consensus_queue.cc:1035] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:47.547246 23579 tablet_replica.cc:439] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: TxnStatusTablet state changed. Reason: New leader 9910403d86954208840783edf6460af8. Latest consensus state: current_term: 1 leader_uuid: "9910403d86954208840783edf6460af8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } }
I20260807 10:43:47.547631 23579 tablet_replica.cc:442] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:43:47.550267 23580 tablet_replica.cc:439] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: TxnStatusTablet state changed. Reason: New leader 9910403d86954208840783edf6460af8. Latest consensus state: current_term: 1 leader_uuid: "9910403d86954208840783edf6460af8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } }
I20260807 10:43:47.550634 23580 tablet_replica.cc:442] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:43:47.552196 23599 mvcc.cc:205] Tried to move back new op lower bound from 7315863255133401088 to 7315863254944251904. Current Snapshot: MvccSnapshot[applied={T|T < 7315863255133401088}]
I20260807 10:43:47.551186 23585 tablet_replica.cc:439] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9910403d86954208840783edf6460af8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } }
I20260807 10:43:47.553777 23585 tablet_replica.cc:442] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:43:47.554873 23580 tablet_replica.cc:439] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9910403d86954208840783edf6460af8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } }
I20260807 10:43:47.555200 23580 tablet_replica.cc:442] T 6863777655054f778d495c28f93e77c7 P 7a3a06667c0941c696c4a2870b8e57dc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:43:47.566917 23650 tablet_replica.cc:439] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9910403d86954208840783edf6460af8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } }
I20260807 10:43:47.567365 23650 tablet_replica.cc:442] T 6863777655054f778d495c28f93e77c7 P 9910403d86954208840783edf6460af8: This TxnStatusTablet replica's current role is: LEADER
I20260807 10:43:47.577210 23579 tablet_replica.cc:439] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9910403d86954208840783edf6460af8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } } }
I20260807 10:43:47.577558 23579 tablet_replica.cc:442] T 6863777655054f778d495c28f93e77c7 P c9a8fc20401e49d788a2543b2316e350: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 10:43:47.585371 23580 consensus_queue.cc:1035] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:47.591135 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.583015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52746 (local address 127.11.46.131:43733)
0807 10:43:47.583249 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.583257 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.583836 (+ 579us) server_negotiation.cc:407] Connection header received
0807 10:43:47.584166 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.584171 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.584293 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.584496 (+ 203us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:47.585139 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.586203 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.588217 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.588673 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.588812 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.589546 (+ 734us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:47.590426 (+ 880us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:47.590573 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.590662 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.590760 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:43:47.594796 23580 consensus_queue.cc:1035] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:47.611019 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.603922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:42401 (local address 127.11.46.130:40221)
0807 10:43:47.604120 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.604127 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.604800 (+ 673us) server_negotiation.cc:407] Connection header received
0807 10:43:47.604980 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.604986 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.605086 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.605185 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:47.605736 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.606873 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.608391 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.609208 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.609351 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.609909 (+ 558us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:47.610065 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:47.610161 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.610557 (+ 396us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.610663 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:43:47.611203 23660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.603945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:40221 (local address 127.11.46.131:42401)
0807 10:43:47.604681 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:47.604703 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:47.604843 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:47.605203 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:47.605206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:47.605216 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:43:47.605557 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.605571 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.607039 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.607044 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.608215 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.608232 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.609422 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.609426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.609631 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.609710 (+ 79us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:43:47.610314 (+ 604us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:43:47.610345 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 10:43:47.610494 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 10:43:47.610838 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":411,"threads_started":1}
I20260807 10:43:47.656847 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.649106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:45863 (local address 127.11.46.131:43733)
0807 10:43:47.649311 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.649317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.650917 (+ 1600us) server_negotiation.cc:407] Connection header received
0807 10:43:47.651243 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.651249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.651346 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.651447 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:47.651943 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.653063 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.654869 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.655453 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.655590 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.656065 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:47.656196 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:47.656271 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.656427 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.656520 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:43:47.657130 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.649165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:43733 (local address 127.11.46.130:45863)
0807 10:43:47.650807 (+ 1642us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:47.650828 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:47.651039 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:47.651473 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:47.651476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:47.651488 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:43:47.651798 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.651807 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.653200 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.653205 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.654552 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:47.654569 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.655659 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.655666 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:47.655799 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.655867 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:43:47.656296 (+ 429us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:43:47.656309 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 10:43:47.656378 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 10:43:47.656538 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1399,"thread_start_us":824,"threads_started":1}
I20260807 10:43:47.707834 22802 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:47.708132 22802 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:47.712399 22802 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716: Sending DeleteTablet for 3 replicas of tablet 9664889f75f7487e8b6ba833706fe70c
I20260807 10:43:47.713866 23001 tablet_service.cc:1514] Processing DeleteTablet for tablet 9664889f75f7487e8b6ba833706fe70c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:47 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:40452
I20260807 10:43:47.714424 23436 tablet_service.cc:1514] Processing DeleteTablet for tablet 9664889f75f7487e8b6ba833706fe70c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:47 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:52734
I20260807 10:43:47.721360 23221 tablet_service.cc:1514] Processing DeleteTablet for tablet 9664889f75f7487e8b6ba833706fe70c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:47 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:39136
I20260807 10:43:47.764256 23672 tablet_replica.cc:330] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8: stopping tablet replica
I20260807 10:43:47.764564 23672 raft_consensus.cc:2229] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:47.764945 23672 raft_consensus.cc:2258] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:47.766317 23670 tablet_replica.cc:330] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc: stopping tablet replica
I20260807 10:43:47.766551 23670 raft_consensus.cc:2229] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:43:47.767227 23670 raft_consensus.cc:2258] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:47.767910 23668 tablet_replica.cc:330] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350: stopping tablet replica
I20260807 10:43:47.768129 23668 raft_consensus.cc:2229] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:47.768366 23668 raft_consensus.cc:2258] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:47.771011 23668 ts_tablet_manager.cc:1905] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:47.771364 23672 ts_tablet_manager.cc:1905] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:47.774672 23670 ts_tablet_manager.cc:1905] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:47.779627 23672 ts_tablet_manager.cc:1918] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:43:47.779949 23672 log.cc:1196] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/9664889f75f7487e8b6ba833706fe70c
I20260807 10:43:47.780543 23672 ts_tablet_manager.cc:1939] T 9664889f75f7487e8b6ba833706fe70c P 9910403d86954208840783edf6460af8: Deleting consensus metadata
I20260807 10:43:47.782171 22788 catalog_manager.cc:4841] TS 9910403d86954208840783edf6460af8 (127.11.46.130:40221): tablet 9664889f75f7487e8b6ba833706fe70c (table test-table [id=81592b6374074f46a4e4205d1d8254ea]) successfully deleted
I20260807 10:43:47.793989 23670 ts_tablet_manager.cc:1918] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:43:47.794186 23670 log.cc:1196] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/9664889f75f7487e8b6ba833706fe70c
I20260807 10:43:47.794723 23670 ts_tablet_manager.cc:1939] T 9664889f75f7487e8b6ba833706fe70c P 7a3a06667c0941c696c4a2870b8e57dc: Deleting consensus metadata
I20260807 10:43:47.796160 22786 catalog_manager.cc:4841] TS 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733): tablet 9664889f75f7487e8b6ba833706fe70c (table test-table [id=81592b6374074f46a4e4205d1d8254ea]) successfully deleted
I20260807 10:43:47.797053 23668 ts_tablet_manager.cc:1918] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:43:47.797214 23668 log.cc:1196] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/9664889f75f7487e8b6ba833706fe70c
I20260807 10:43:47.797812 23668 ts_tablet_manager.cc:1939] T 9664889f75f7487e8b6ba833706fe70c P c9a8fc20401e49d788a2543b2316e350: Deleting consensus metadata
I20260807 10:43:47.799273 22788 catalog_manager.cc:4841] TS c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809): tablet 9664889f75f7487e8b6ba833706fe70c (table test-table [id=81592b6374074f46a4e4205d1d8254ea]) successfully deleted
Aug 07 10:43:47 dist-test-slave-42z9 krb5kdc[22740](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260807 10:43:47.847002 11450 mini_kdc.cc:317] Time spent kinit for test-admin: real 0.122s user 0.000s sys 0.029s
Aug 07 10:43:47 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:47 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 10:43:47.874209 23683 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:47.850767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55592 (local address 127.11.46.190:36201)
0807 10:43:47.857965 (+ 7198us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.857973 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.858427 (+ 454us) server_negotiation.cc:407] Connection header received
0807 10:43:47.858649 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.858655 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.858751 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.858888 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:47.860876 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.862082 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.864153 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.864847 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.864998 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.873890 (+ 8892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55592: BlockingRecv error: recv got EOF from 127.0.0.1:55592 (error 108)
Metrics: {"server-negotiator.queue_time_us":7022,"thread_start_us":6850,"threads_started":1}
Aug 07 10:43:47 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM
I20260807 10:43:47.908794 23683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:47.885544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55602 (local address 127.11.46.190:36201)
0807 10:43:47.885774 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:47.885781 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:47.889410 (+ 3629us) server_negotiation.cc:407] Connection header received
0807 10:43:47.889798 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:47.889805 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:47.889917 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:47.890025 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:47.891795 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.892979 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.894912 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:47.895606 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:47.895752 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:47.901490 (+ 5738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:47.901535 (+ 45us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:47.901541 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:47.901610 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:47.905357 (+ 3747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:47.906381 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:47.906387 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:47.906391 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:47.906615 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:47.907113 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:47.907119 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:47.907122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:47.907528 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:47.907795 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:47.908136 (+ 341us) server_negotiation.cc:299] Negotiation successful
0807 10:43:47.908401 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 10:43:47.913308 22802 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:43:47.914218 22802 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:43:47.923944 23001 tablet_service.cc:1467] Processing CreateTablet for tablet 469092297137435187032ef873110f4c (DEFAULT_TABLE table=test-table [id=f7893969886e4d9aa661a9d14c936eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:47.923923 23436 tablet_service.cc:1467] Processing CreateTablet for tablet 469092297137435187032ef873110f4c (DEFAULT_TABLE table=test-table [id=f7893969886e4d9aa661a9d14c936eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:47.924491 23001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 469092297137435187032ef873110f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:47.924496 23436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 469092297137435187032ef873110f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:47.927035 23221 tablet_service.cc:1467] Processing CreateTablet for tablet 469092297137435187032ef873110f4c (DEFAULT_TABLE table=test-table [id=f7893969886e4d9aa661a9d14c936eb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:47.927579 23221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 469092297137435187032ef873110f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:47.936971 23691 tablet_bootstrap.cc:492] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc: Bootstrap starting.
I20260807 10:43:47.940505 23691 tablet_bootstrap.cc:654] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:47.955332 23691 tablet_bootstrap.cc:492] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc: No bootstrap required, opened a new log
I20260807 10:43:47.955551 23691 ts_tablet_manager.cc:1397] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc: Time spent bootstrapping tablet: real 0.019s user 0.017s sys 0.000s
I20260807 10:43:47.956475 23694 tablet_bootstrap.cc:492] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350: Bootstrap starting.
I20260807 10:43:47.956497 23691 raft_consensus.cc:348] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.956786 23691 raft_consensus.cc:374] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:47.956894 23691 raft_consensus.cc:729] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3a06667c0941c696c4a2870b8e57dc, State: Initialized, Role: FOLLOWER
I20260807 10:43:47.957217 23691 consensus_queue.cc:260] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.961014 23694 tablet_bootstrap.cc:654] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:47.961032 23691 ts_tablet_manager.cc:1428] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 10:43:47.962379 23692 tablet_bootstrap.cc:492] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8: Bootstrap starting.
I20260807 10:43:47.964762 23692 tablet_bootstrap.cc:654] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:47.965278 23694 tablet_bootstrap.cc:492] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350: No bootstrap required, opened a new log
I20260807 10:43:47.965538 23694 ts_tablet_manager.cc:1397] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s
I20260807 10:43:47.966529 23694 raft_consensus.cc:348] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.966912 23694 raft_consensus.cc:374] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:47.967057 23694 raft_consensus.cc:729] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a8fc20401e49d788a2543b2316e350, State: Initialized, Role: FOLLOWER
I20260807 10:43:47.967445 23694 consensus_queue.cc:260] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.970826 23694 ts_tablet_manager.cc:1428] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260807 10:43:47.976060 23692 tablet_bootstrap.cc:492] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8: No bootstrap required, opened a new log
I20260807 10:43:47.976274 23692 ts_tablet_manager.cc:1397] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260807 10:43:47.977257 23692 raft_consensus.cc:348] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.977583 23692 raft_consensus.cc:374] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:47.977692 23692 raft_consensus.cc:729] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9910403d86954208840783edf6460af8, State: Initialized, Role: FOLLOWER
I20260807 10:43:47.977982 23692 consensus_queue.cc:260] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:47.978629 23692 ts_tablet_manager.cc:1428] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 10:43:48.016534 23585 raft_consensus.cc:482] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:43:48.016763 23585 raft_consensus.cc:504] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.017616 23585 leader_election.cc:288] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809), 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733)
I20260807 10:43:48.018235 23030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469092297137435187032ef873110f4c" candidate_uuid: "9910403d86954208840783edf6460af8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a8fc20401e49d788a2543b2316e350" is_pre_election: true
I20260807 10:43:48.018513 23030 raft_consensus.cc:2454] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9910403d86954208840783edf6460af8 in term 0.
I20260807 10:43:48.018440 23460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469092297137435187032ef873110f4c" candidate_uuid: "9910403d86954208840783edf6460af8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3a06667c0941c696c4a2870b8e57dc" is_pre_election: true
I20260807 10:43:48.018738 23460 raft_consensus.cc:2454] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9910403d86954208840783edf6460af8 in term 0.
I20260807 10:43:48.019025 23141 leader_election.cc:302] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9910403d86954208840783edf6460af8, c9a8fc20401e49d788a2543b2316e350; no voters:
I20260807 10:43:48.019510 23585 raft_consensus.cc:2781] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:43:48.019677 23585 raft_consensus.cc:482] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:43:48.019793 23585 raft_consensus.cc:3037] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:48.023136 23585 raft_consensus.cc:504] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.024569 23030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469092297137435187032ef873110f4c" candidate_uuid: "9910403d86954208840783edf6460af8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9a8fc20401e49d788a2543b2316e350"
I20260807 10:43:48.024863 23030 raft_consensus.cc:3037] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:48.027801 23030 raft_consensus.cc:2454] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9910403d86954208840783edf6460af8 in term 1.
I20260807 10:43:48.028321 23460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "469092297137435187032ef873110f4c" candidate_uuid: "9910403d86954208840783edf6460af8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3a06667c0941c696c4a2870b8e57dc"
I20260807 10:43:48.028507 23141 leader_election.cc:302] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9910403d86954208840783edf6460af8, c9a8fc20401e49d788a2543b2316e350; no voters:
I20260807 10:43:48.028571 23460 raft_consensus.cc:3037] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:48.029045 23639 raft_consensus.cc:2781] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:48.029225 23639 raft_consensus.cc:686] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 1 LEADER]: Becoming Leader. State: Replica: 9910403d86954208840783edf6460af8, State: Running, Role: LEADER
I20260807 10:43:48.029657 23639 consensus_queue.cc:237] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.031801 23460 raft_consensus.cc:2454] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9910403d86954208840783edf6460af8 in term 1.
I20260807 10:43:48.034031 23585 leader_election.cc:288] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [CANDIDATE]: Term 1 election: Requested vote from peers c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809), 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733)
I20260807 10:43:48.036402 22803 catalog_manager.cc:5495] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9910403d86954208840783edf6460af8 (127.11.46.130). New cstate: current_term: 1 leader_uuid: "9910403d86954208840783edf6460af8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } health_report { overall_health: UNKNOWN } } }
I20260807 10:43:48.065842 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:48.059714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39156 (local address 127.11.46.130:40221)
0807 10:43:48.060087 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:48.060095 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:48.060122 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:43:48.060370 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:48.060375 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:48.060460 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:48.060571 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:48.061020 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.061850 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.063877 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.064377 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.064488 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:48.065059 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:48.065194 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:48.065257 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:48.065467 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 10:43:48.065571 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188}
I20260807 10:43:48.069839 23460 raft_consensus.cc:1261] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Refusing update from remote peer 9910403d86954208840783edf6460af8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:48.069902 23030 raft_consensus.cc:1261] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Refusing update from remote peer 9910403d86954208840783edf6460af8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:48.070583 23585 consensus_queue.cc:1035] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:48.070993 23639 consensus_queue.cc:1035] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:48.093631 22805 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:48.093928 22805 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:48.097972 23598 mvcc.cc:205] Tried to move back new op lower bound from 7315863257367416832 to 7315863257212628992. Current Snapshot: MvccSnapshot[applied={T|T < 7315863257367416832 or (T in {7315863257367416832})}]
I20260807 10:43:48.100807 22805 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716: Sending DeleteTablet for 3 replicas of tablet 469092297137435187032ef873110f4c
I20260807 10:43:48.101890 23001 tablet_service.cc:1514] Processing DeleteTablet for tablet 469092297137435187032ef873110f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:48 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:40452
I20260807 10:43:48.101912 23436 tablet_service.cc:1514] Processing DeleteTablet for tablet 469092297137435187032ef873110f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:48 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:52734
I20260807 10:43:48.102233 23668 tablet_replica.cc:330] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350: stopping tablet replica
I20260807 10:43:48.102452 23668 raft_consensus.cc:2229] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:48.102520 23670 tablet_replica.cc:330] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc: stopping tablet replica
I20260807 10:43:48.102725 23670 raft_consensus.cc:2229] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:48.102739 23668 raft_consensus.cc:2258] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:48.102957 23670 raft_consensus.cc:2258] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:48.103515 23221 tablet_service.cc:1514] Processing DeleteTablet for tablet 469092297137435187032ef873110f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:48 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:39136
I20260807 10:43:48.104040 23672 tablet_replica.cc:330] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8: stopping tablet replica
I20260807 10:43:48.104281 23672 raft_consensus.cc:2229] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:43:48.104897 23672 raft_consensus.cc:2258] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:48.106201 23436 tablet_service.cc:1514] Processing DeleteTablet for tablet 469092297137435187032ef873110f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:48 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:52734
I20260807 10:43:48.106535 23668 ts_tablet_manager.cc:1905] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:48.106535 23221 tablet_service.cc:1514] Processing DeleteTablet for tablet 469092297137435187032ef873110f4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:48 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:39136
I20260807 10:43:48.107682 23672 ts_tablet_manager.cc:1905] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:48.112749 23670 ts_tablet_manager.cc:1905] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:48.113775 23668 ts_tablet_manager.cc:1918] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:48.114022 23668 log.cc:1196] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/469092297137435187032ef873110f4c
I20260807 10:43:48.114571 23668 ts_tablet_manager.cc:1939] T 469092297137435187032ef873110f4c P c9a8fc20401e49d788a2543b2316e350: Deleting consensus metadata
I20260807 10:43:48.116279 22788 catalog_manager.cc:4841] TS c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809): tablet 469092297137435187032ef873110f4c (table test-table [id=f7893969886e4d9aa661a9d14c936eb3]) successfully deleted
I20260807 10:43:48.118386 22805 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55602:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:43:48.119462 22805 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:43:48.122180 23672 ts_tablet_manager.cc:1918] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:48.122390 23672 log.cc:1196] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/469092297137435187032ef873110f4c
I20260807 10:43:48.122866 23672 ts_tablet_manager.cc:1939] T 469092297137435187032ef873110f4c P 9910403d86954208840783edf6460af8: Deleting consensus metadata
I20260807 10:43:48.124254 22788 catalog_manager.cc:4841] TS 9910403d86954208840783edf6460af8 (127.11.46.130:40221): tablet 469092297137435187032ef873110f4c (table test-table [id=f7893969886e4d9aa661a9d14c936eb3]) successfully deleted
I20260807 10:43:48.129959 23436 tablet_service.cc:1467] Processing CreateTablet for tablet e764aae7b9ac46dca556074bd2971216 (DEFAULT_TABLE table=test-table [id=5a34f435930a433587721cbd5de23e8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:48.130496 23436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e764aae7b9ac46dca556074bd2971216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:48.134356 23001 tablet_service.cc:1467] Processing CreateTablet for tablet e764aae7b9ac46dca556074bd2971216 (DEFAULT_TABLE table=test-table [id=5a34f435930a433587721cbd5de23e8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:48.134382 23221 tablet_service.cc:1467] Processing CreateTablet for tablet e764aae7b9ac46dca556074bd2971216 (DEFAULT_TABLE table=test-table [id=5a34f435930a433587721cbd5de23e8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:43:48.134883 23221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e764aae7b9ac46dca556074bd2971216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:48.134900 23001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e764aae7b9ac46dca556074bd2971216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:48.143944 23694 tablet_bootstrap.cc:492] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350: Bootstrap starting.
I20260807 10:43:48.145466 23691 tablet_bootstrap.cc:492] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc: Bootstrap starting.
I20260807 10:43:48.146150 23694 tablet_bootstrap.cc:654] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:48.147588 23691 tablet_bootstrap.cc:654] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:48.148260 23670 ts_tablet_manager.cc:1918] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:43:48.148428 23670 log.cc:1196] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/469092297137435187032ef873110f4c
I20260807 10:43:48.148936 23670 ts_tablet_manager.cc:1939] T 469092297137435187032ef873110f4c P 7a3a06667c0941c696c4a2870b8e57dc: Deleting consensus metadata
I20260807 10:43:48.150993 23692 tablet_bootstrap.cc:492] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8: Bootstrap starting.
I20260807 10:43:48.155881 23692 tablet_bootstrap.cc:654] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:48.158555 22786 catalog_manager.cc:4841] TS 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733): tablet 469092297137435187032ef873110f4c (table test-table [id=f7893969886e4d9aa661a9d14c936eb3]) successfully deleted
W20260807 10:43:48.159943 22786 catalog_manager.cc:4808] TS 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733): delete failed for tablet 469092297137435187032ef873110f4c because the tablet was not found. No further retry: Not found: Tablet not found: 469092297137435187032ef873110f4c
W20260807 10:43:48.161199 22788 catalog_manager.cc:4808] TS 9910403d86954208840783edf6460af8 (127.11.46.130:40221): delete failed for tablet 469092297137435187032ef873110f4c because the tablet was not found. No further retry: Not found: Tablet not found: 469092297137435187032ef873110f4c
I20260807 10:43:48.163848 23694 tablet_bootstrap.cc:492] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350: No bootstrap required, opened a new log
I20260807 10:43:48.164201 23694 ts_tablet_manager.cc:1397] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.006s
I20260807 10:43:48.164865 23692 tablet_bootstrap.cc:492] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8: No bootstrap required, opened a new log
I20260807 10:43:48.165163 23694 raft_consensus.cc:348] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.165488 23694 raft_consensus.cc:374] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:48.165580 23694 raft_consensus.cc:729] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9a8fc20401e49d788a2543b2316e350, State: Initialized, Role: FOLLOWER
I20260807 10:43:48.165911 23692 ts_tablet_manager.cc:1397] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.004s
I20260807 10:43:48.165879 23694 consensus_queue.cc:260] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.166495 23694 ts_tablet_manager.cc:1428] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260807 10:43:48.167433 23692 raft_consensus.cc:348] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.170037 23692 raft_consensus.cc:374] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:48.171905 23692 raft_consensus.cc:729] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9910403d86954208840783edf6460af8, State: Initialized, Role: FOLLOWER
I20260807 10:43:48.172585 23692 consensus_queue.cc:260] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.177976 23692 ts_tablet_manager.cc:1428] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260807 10:43:48.179250 23691 tablet_bootstrap.cc:492] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc: No bootstrap required, opened a new log
I20260807 10:43:48.179543 23691 ts_tablet_manager.cc:1397] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.008s
I20260807 10:43:48.180795 23691 raft_consensus.cc:348] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.181260 23691 raft_consensus.cc:374] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:48.181389 23691 raft_consensus.cc:729] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a3a06667c0941c696c4a2870b8e57dc, State: Initialized, Role: FOLLOWER
I20260807 10:43:48.181875 23691 consensus_queue.cc:260] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.185809 23691 ts_tablet_manager.cc:1428] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260807 10:43:48.189079 23579 raft_consensus.cc:482] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:43:48.189304 23579 raft_consensus.cc:504] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.190088 23579 leader_election.cc:288] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9910403d86954208840783edf6460af8 (127.11.46.130:40221), 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733)
I20260807 10:43:48.190625 23249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e764aae7b9ac46dca556074bd2971216" candidate_uuid: "c9a8fc20401e49d788a2543b2316e350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9910403d86954208840783edf6460af8" is_pre_election: true
I20260807 10:43:48.190795 23460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e764aae7b9ac46dca556074bd2971216" candidate_uuid: "c9a8fc20401e49d788a2543b2316e350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3a06667c0941c696c4a2870b8e57dc" is_pre_election: true
I20260807 10:43:48.190934 23249 raft_consensus.cc:2454] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a8fc20401e49d788a2543b2316e350 in term 0.
I20260807 10:43:48.191056 23460 raft_consensus.cc:2454] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9a8fc20401e49d788a2543b2316e350 in term 0.
I20260807 10:43:48.191556 22928 leader_election.cc:302] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a3a06667c0941c696c4a2870b8e57dc, c9a8fc20401e49d788a2543b2316e350; no voters:
I20260807 10:43:48.191862 23579 raft_consensus.cc:2781] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:43:48.192008 23579 raft_consensus.cc:482] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:43:48.192106 23579 raft_consensus.cc:3037] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:48.194414 23579 raft_consensus.cc:504] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.195116 23579 leader_election.cc:288] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [CANDIDATE]: Term 1 election: Requested vote from peers 9910403d86954208840783edf6460af8 (127.11.46.130:40221), 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733)
I20260807 10:43:48.195758 23249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e764aae7b9ac46dca556074bd2971216" candidate_uuid: "c9a8fc20401e49d788a2543b2316e350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9910403d86954208840783edf6460af8"
I20260807 10:43:48.196055 23249 raft_consensus.cc:3037] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:48.196255 23460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e764aae7b9ac46dca556074bd2971216" candidate_uuid: "c9a8fc20401e49d788a2543b2316e350" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a3a06667c0941c696c4a2870b8e57dc"
I20260807 10:43:48.196518 23460 raft_consensus.cc:3037] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:48.199448 23249 raft_consensus.cc:2454] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a8fc20401e49d788a2543b2316e350 in term 1.
I20260807 10:43:48.199963 22930 leader_election.cc:302] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9910403d86954208840783edf6460af8, c9a8fc20401e49d788a2543b2316e350; no voters:
I20260807 10:43:48.200376 23579 raft_consensus.cc:2781] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:48.201961 23460 raft_consensus.cc:2454] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9a8fc20401e49d788a2543b2316e350 in term 1.
I20260807 10:43:48.205734 23579 raft_consensus.cc:686] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 1 LEADER]: Becoming Leader. State: Replica: c9a8fc20401e49d788a2543b2316e350, State: Running, Role: LEADER
I20260807 10:43:48.206143 23579 consensus_queue.cc:237] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } }
I20260807 10:43:48.209072 22803 catalog_manager.cc:5495] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 reported cstate change: term changed from 0 to 1, leader changed from <none> to c9a8fc20401e49d788a2543b2316e350 (127.11.46.129). New cstate: current_term: 1 leader_uuid: "c9a8fc20401e49d788a2543b2316e350" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9a8fc20401e49d788a2543b2316e350" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 } health_report { overall_health: UNKNOWN } } }
I20260807 10:43:48.238897 23714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:48.231684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40478 (local address 127.11.46.129:37809)
0807 10:43:48.233971 (+ 2287us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:48.233976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:48.233993 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:43:48.234059 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:48.234063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:48.234133 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:48.234226 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:48.234682 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.235442 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.236811 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.237272 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.237390 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:48.238016 (+ 626us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:48.238158 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:48.238243 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:48.238408 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 10:43:48.238497 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2161,"thread_start_us":2014,"threads_started":1}
I20260807 10:43:48.256002 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:48.250297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:59529 (local address 127.11.46.130:40221)
0807 10:43:48.250507 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:48.250513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:48.250586 (+ 73us) server_negotiation.cc:407] Connection header received
0807 10:43:48.250898 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:48.250902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:48.250976 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:48.251057 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:48.251578 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.252562 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.254046 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.254534 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.254661 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:48.255141 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:48.255302 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:48.255381 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:48.255546 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 10:43:48.255646 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:43:48.256074 23718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:48.249821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:40221 (local address 127.11.46.129:59529)
0807 10:43:48.250474 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:48.250495 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:48.250732 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:48.251092 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:48.251098 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:48.251111 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:43:48.251411 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:48.251421 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.252714 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.252718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:48.253894 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:48.253908 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.254733 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.254739 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:48.254869 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:48.254945 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:43:48.255404 (+ 459us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:43:48.255417 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 10:43:48.255488 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 10:43:48.255654 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":711,"threads_started":1}
I20260807 10:43:48.267907 23460 raft_consensus.cc:1261] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Refusing update from remote peer c9a8fc20401e49d788a2543b2316e350: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:48.267937 23249 raft_consensus.cc:1261] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Refusing update from remote peer c9a8fc20401e49d788a2543b2316e350: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:43:48.268633 23709 consensus_queue.cc:1035] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a3a06667c0941c696c4a2870b8e57dc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:48.269532 23709 consensus_queue.cc:1035] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9910403d86954208840783edf6460af8" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:43:48.319703 23714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:48.312272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:58537 (local address 127.11.46.129:37809)
0807 10:43:48.312700 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:48.312706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:48.313326 (+ 620us) server_negotiation.cc:407] Connection header received
0807 10:43:48.313557 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:48.313561 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:48.313634 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:48.313710 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:43:48.314646 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.315681 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.317776 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.318215 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.318339 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:48.318846 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:43:48.319016 (+ 170us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:43:48.319117 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:48.319282 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 10:43:48.319395 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279}
I20260807 10:43:48.319845 23722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:48.312358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37809 (local address 127.11.46.130:58537)
0807 10:43:48.313210 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:48.313231 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:48.313383 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:48.313762 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:48.313768 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:48.313782 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 10:43:48.314182 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:48.314196 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.315836 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.315843 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:48.317605 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:48.317625 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.318419 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.318427 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:48.318582 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:48.318641 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 10:43:48.319142 (+ 501us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 10:43:48.319157 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 10:43:48.319248 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:43:48.319428 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":476,"threads_started":1}
I20260807 10:43:48.362994 22805 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:48.363337 22805 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55602:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:43:48.367290 22805 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4c6ca116c7ef469e9ae6ccb6c6dc2716: Sending DeleteTablet for 3 replicas of tablet e764aae7b9ac46dca556074bd2971216
I20260807 10:43:48.368371 23001 tablet_service.cc:1514] Processing DeleteTablet for tablet e764aae7b9ac46dca556074bd2971216 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:48 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:40452
I20260807 10:43:48.368386 23436 tablet_service.cc:1514] Processing DeleteTablet for tablet e764aae7b9ac46dca556074bd2971216 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:48 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:52734
I20260807 10:43:48.368717 23668 tablet_replica.cc:330] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350: stopping tablet replica
I20260807 10:43:48.368733 23670 tablet_replica.cc:330] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc: stopping tablet replica
I20260807 10:43:48.368918 23668 raft_consensus.cc:2229] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:43:48.368924 23670 raft_consensus.cc:2229] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:48.369078 23221 tablet_service.cc:1514] Processing DeleteTablet for tablet e764aae7b9ac46dca556074bd2971216 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:43:48 UTC) from {username='oryx', principal='oryx/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:39136
I20260807 10:43:48.369170 23670 raft_consensus.cc:2258] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:48.369280 23668 raft_consensus.cc:2258] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:48.370074 23672 tablet_replica.cc:330] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8: stopping tablet replica
I20260807 10:43:48.370249 23672 raft_consensus.cc:2229] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:43:48.370442 23672 raft_consensus.cc:2258] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:43:48.370630 23668 ts_tablet_manager.cc:1905] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:48.371577 23672 ts_tablet_manager.cc:1905] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:48.371567 23670 ts_tablet_manager.cc:1905] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:43:48.378274 23668 ts_tablet_manager.cc:1918] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:43:48.378578 23668 log.cc:1196] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/e764aae7b9ac46dca556074bd2971216
I20260807 10:43:48.378823 23670 ts_tablet_manager.cc:1918] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:43:48.379208 23668 ts_tablet_manager.cc:1939] T e764aae7b9ac46dca556074bd2971216 P c9a8fc20401e49d788a2543b2316e350: Deleting consensus metadata
I20260807 10:43:48.379408 23672 ts_tablet_manager.cc:1918] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 10:43:48.379593 23672 log.cc:1196] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/e764aae7b9ac46dca556074bd2971216
I20260807 10:43:48.380160 23672 ts_tablet_manager.cc:1939] T e764aae7b9ac46dca556074bd2971216 P 9910403d86954208840783edf6460af8: Deleting consensus metadata
I20260807 10:43:48.380972 22788 catalog_manager.cc:4841] TS c9a8fc20401e49d788a2543b2316e350 (127.11.46.129:37809): tablet e764aae7b9ac46dca556074bd2971216 (table test-table [id=5a34f435930a433587721cbd5de23e8b]) successfully deleted
I20260807 10:43:48.381593 22788 catalog_manager.cc:4841] TS 9910403d86954208840783edf6460af8 (127.11.46.130:40221): tablet e764aae7b9ac46dca556074bd2971216 (table test-table [id=5a34f435930a433587721cbd5de23e8b]) successfully deleted
I20260807 10:43:48.382407 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 22905
I20260807 10:43:48.383034 23670 log.cc:1196] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/e764aae7b9ac46dca556074bd2971216
I20260807 10:43:48.383534 23670 ts_tablet_manager.cc:1939] T e764aae7b9ac46dca556074bd2971216 P 7a3a06667c0941c696c4a2870b8e57dc: Deleting consensus metadata
I20260807 10:43:48.384968 22786 catalog_manager.cc:4841] TS 7a3a06667c0941c696c4a2870b8e57dc (127.11.46.131:43733): tablet e764aae7b9ac46dca556074bd2971216 (table test-table [id=5a34f435930a433587721cbd5de23e8b]) successfully deleted
Aug 07 10:43:48 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.129@KRBTEST.COM
I20260807 10:43:48.400936 23714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:48.383702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40494 (local address 127.11.46.129:37809)
0807 10:43:48.383909 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:48.383915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:48.383956 (+ 41us) server_negotiation.cc:407] Connection header received
0807 10:43:48.384218 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:48.384224 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:48.384310 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:48.384386 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:48.386271 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.387010 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.388842 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.389304 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.389405 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:48.394620 (+ 5215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:48.394641 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:48.394660 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:48.394708 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:48.397876 (+ 3168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:48.398779 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:48.398787 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:48.398789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:48.398955 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:48.399321 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:48.399324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:48.399326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:48.399732 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:48.400002 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:48.400334 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 10:43:48.400559 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 10:43:48.401755 23098 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:48.535111 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 22905
I20260807 10:43:48.592689 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 23112
Aug 07 10:43:48 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.130@KRBTEST.COM
I20260807 10:43:48.610309 23568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:48.593680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39166 (local address 127.11.46.130:40221)
0807 10:43:48.593904 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:48.593911 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:48.593932 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:43:48.594002 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:48.594008 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:48.594089 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:48.594188 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:48.595488 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.596624 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.598054 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.598855 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.598992 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:48.603807 (+ 4815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:48.603829 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:48.603848 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:48.603896 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:48.607292 (+ 3396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:48.608160 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:48.608168 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:48.608171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:48.608333 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:48.608704 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:48.608707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:48.608709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:48.609112 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:48.609400 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:48.609761 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 10:43:48.609952 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:43:48.611088 23322 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:48.782027 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 23112
I20260807 10:43:48.821897 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 23335
Aug 07 10:43:48 dist-test-slave-42z9 krb5kdc[22740](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.46.131@KRBTEST.COM
I20260807 10:43:48.841248 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:48.822745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52756 (local address 127.11.46.131:43733)
0807 10:43:48.823247 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:48.823251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:48.823267 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:43:48.823325 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:48.823329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:48.823424 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:48.823527 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:48.824920 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.825910 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.827246 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:48.827701 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:48.827829 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:48.835386 (+ 7557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:48.835408 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:48.835429 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:48.835491 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:48.838476 (+ 2985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:48.839310 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:48.839317 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:48.839319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:48.839551 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:48.839862 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:48.839865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:48.839867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:48.840261 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:48.840543 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:48.840749 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 10:43:48.840941 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":250,"threads_started":1}
I20260807 10:43:48.842020 23533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:48.972373 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 23335
I20260807 10:43:49.005548 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 22767
I20260807 10:43:49.006896 22862 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:49.146164 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 22767
2026-08-07T10:43:49Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7507 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:43:49 dist-test-slave-42z9 krb5kdc[23739](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:43:49 dist-test-slave-42z9 krb5kdc[23739](info): set up 2 sockets
Aug 07 10:43:49 dist-test-slave-42z9 krb5kdc[23739](info): commencing operation
krb5kdc: starting...
W20260807 10:43:50.402158 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.004s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:43:50 dist-test-slave-42z9 krb5kdc[23739](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099430, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:43:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:43:50.743305 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:40335
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:40335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:51.131052 23760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:51.131443 23760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:51.131573 23760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:51.139793 23760 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:51.139947 23760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:51.139997 23760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:51.140080 23760 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:51.140164 23760 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:51.152133 23760 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:40335
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:40335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:51.154330 23760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:51.156461 23760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:51.170976 23771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:51.170930 23768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:51.171080 23767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:51.171605 23760 server_base.cc:1034] running on GCE node
I20260807 10:43:51.172796 23760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:51.174587 23760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:51.175881 23760 hybrid_clock.cc:648] HybridClock initialized: now 1786099431175822 us; error 58 us; skew 500 ppm
I20260807 10:43:51.176306 23760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T10:43:51Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2091 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:43:51 dist-test-slave-42z9 krb5kdc[23779](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:43:51 dist-test-slave-42z9 krb5kdc[23779](info): set up 2 sockets
Aug 07 10:43:51 dist-test-slave-42z9 krb5kdc[23779](info): commencing operation
krb5kdc: starting...
W20260807 10:43:52.483817 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.001s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:43:52 dist-test-slave-42z9 krb5kdc[23779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:43:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:43:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:43:52.810670 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:42791
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:42791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:53.192407 23804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:53.192759 23804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:53.192907 23804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:53.200789 23804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:53.200956 23804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:53.201007 23804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:53.201059 23804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:53.201097 23804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:53.211972 23804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:42791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:42791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:53.213629 23804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:53.215128 23804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:53.228754 23812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:53.228713 23816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:53.228803 23813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:53.230885 23804 server_base.cc:1034] running on GCE node
I20260807 10:43:53.231848 23804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:53.233613 23804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:53.234853 23804 hybrid_clock.cc:648] HybridClock initialized: now 1786099433234798 us; error 41 us; skew 500 ppm
I20260807 10:43:53.235287 23804 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:53 dist-test-slave-42z9 krb5kdc[23779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099433, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:53.238971 23804 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:43:53.240908 23804 webserver.cc:460] Webserver started at http://127.11.46.190:41605/ using document root <none> and password file <none>
I20260807 10:43:53.241852 23804 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:53.241981 23804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:53.242316 23804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:53.245772 23804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "2bab9ce79d3b43d591b5ea109a9695c6"
format_stamp: "Formatted at 2026-08-07 10:43:53 on dist-test-slave-42z9"
server_key: "d56f1f1f9d53f89f652398d384e449ee"
server_key_iv: "fa28a25e8568c41ebd5e2be4495a3901"
server_key_version: "encryptionkey@0"
I20260807 10:43:53.246687 23804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "2bab9ce79d3b43d591b5ea109a9695c6"
format_stamp: "Formatted at 2026-08-07 10:43:53 on dist-test-slave-42z9"
server_key: "d56f1f1f9d53f89f652398d384e449ee"
server_key_iv: "fa28a25e8568c41ebd5e2be4495a3901"
server_key_version: "encryptionkey@0"
I20260807 10:43:53.252909 23804 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260807 10:43:53.257045 23824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:53.258932 23804 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:53.259167 23804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "2bab9ce79d3b43d591b5ea109a9695c6"
format_stamp: "Formatted at 2026-08-07 10:43:53 on dist-test-slave-42z9"
server_key: "d56f1f1f9d53f89f652398d384e449ee"
server_key_iv: "fa28a25e8568c41ebd5e2be4495a3901"
server_key_version: "encryptionkey@0"
I20260807 10:43:53.259402 23804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:53.299052 23804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:53.303973 23804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:53.304301 23804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:53.324000 23804 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:42791
I20260807 10:43:53.324024 23902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:42791 every 8 connection(s)
I20260807 10:43:53.325546 23804 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:53.329906 23903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:43:53.334129 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 23804
I20260807 10:43:53.334369 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:43:53.335012 11450 external_mini_cluster.cc:1428] Setting key ff453535b779d2b54f09b2f9aece63c4
I20260807 10:43:53.342713 23903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6: Bootstrap starting.
I20260807 10:43:53.346902 23903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6: Neither blocks nor log segments found. Creating new log.
I20260807 10:43:53.348274 23903 log.cc:824] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6: Log is configured to *not* fsync() on all Append() calls
Aug 07 10:43:53 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:53.352138 23903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6: No bootstrap required, opened a new log
I20260807 10:43:53.361519 23906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:53.337237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59910 (local address 127.11.46.190:42791)
0807 10:43:53.338149 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:53.338161 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:53.338210 (+ 49us) server_negotiation.cc:407] Connection header received
0807 10:43:53.340715 (+ 2505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:53.340750 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:53.341246 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:53.341688 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:53.343736 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:53.345215 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:53.347015 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:53.347803 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:53.347956 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:53.352962 (+ 5006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:53.352973 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:53.352992 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:53.353044 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:53.356390 (+ 3346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:53.357423 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:53.357433 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:53.357481 (+ 48us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:53.357712 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:53.358150 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:53.358154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:53.358156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:53.358840 (+ 684us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:53.359158 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:53.359780 (+ 622us) server_negotiation.cc:299] Negotiation successful
0807 10:43:53.360278 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":666,"thread_start_us":434,"threads_started":1}
I20260807 10:43:53.361845 23903 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } }
I20260807 10:43:53.362267 23903 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:43:53.362375 23903 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bab9ce79d3b43d591b5ea109a9695c6, State: Initialized, Role: FOLLOWER
I20260807 10:43:53.363009 23903 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } }
I20260807 10:43:53.363322 23903 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:53.363488 23903 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:53.363739 23903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:43:53.366720 23903 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } }
I20260807 10:43:53.367327 23903 leader_election.cc:302] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bab9ce79d3b43d591b5ea109a9695c6; no voters:
I20260807 10:43:53.367980 23903 leader_election.cc:288] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:43:53.368144 23913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:43:53.368815 23913 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 1 LEADER]: Becoming Leader. State: Replica: 2bab9ce79d3b43d591b5ea109a9695c6, State: Running, Role: LEADER
I20260807 10:43:53.369382 23913 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } }
I20260807 10:43:53.370304 23903 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:53.373010 23915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2bab9ce79d3b43d591b5ea109a9695c6. Latest consensus state: current_term: 1 leader_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } } }
I20260807 10:43:53.373118 23914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } } }
I20260807 10:43:53.373421 23915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:53.373502 23914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:53.374459 23922 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:53.386860 23922 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:53.397949 23922 catalog_manager.cc:1347] Generated new cluster ID: b9a3592557614ddd953e10bbc87aa07f
I20260807 10:43:53.398097 23922 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:53.426453 23922 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:43:53.428030 23922 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:53.436918 23922 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6: Generated new TSK 0
I20260807 10:43:53.438377 23922 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:43:53.521258 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42791
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:53.919145 23948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:53.919517 23948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:53.919656 23948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:53.927541 23948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:53.927712 23948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:53.927886 23948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:53.938687 23948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:53.940150 23948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:53.941640 23948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:53.956353 23962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:53.956315 23960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:53.956385 23959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:53.957245 23948 server_base.cc:1034] running on GCE node
I20260807 10:43:53.958065 23948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:53.959200 23948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:53.960429 23948 hybrid_clock.cc:648] HybridClock initialized: now 1786099433960370 us; error 57 us; skew 500 ppm
I20260807 10:43:53.960832 23948 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:53 dist-test-slave-42z9 krb5kdc[23779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099433, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:53.967724 23948 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:43:53.969529 23948 webserver.cc:460] Webserver started at http://127.11.46.129:41845/ using document root <none> and password file <none>
I20260807 10:43:53.970484 23948 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:53.970647 23948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:53.971011 23948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:53.974557 23948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "6a38a9647b5b490782a639552b5b3c70"
format_stamp: "Formatted at 2026-08-07 10:43:53 on dist-test-slave-42z9"
server_key: "e43bfdbaebd68b898732a0e3c81ccf62"
server_key_iv: "e1b4e033997b11e96785b95c39e8294c"
server_key_version: "encryptionkey@0"
I20260807 10:43:53.975553 23948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "6a38a9647b5b490782a639552b5b3c70"
format_stamp: "Formatted at 2026-08-07 10:43:53 on dist-test-slave-42z9"
server_key: "e43bfdbaebd68b898732a0e3c81ccf62"
server_key_iv: "e1b4e033997b11e96785b95c39e8294c"
server_key_version: "encryptionkey@0"
I20260807 10:43:53.982487 23948 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:43:53.986939 23970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:53.988629 23948 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260807 10:43:53.988853 23948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "6a38a9647b5b490782a639552b5b3c70"
format_stamp: "Formatted at 2026-08-07 10:43:53 on dist-test-slave-42z9"
server_key: "e43bfdbaebd68b898732a0e3c81ccf62"
server_key_iv: "e1b4e033997b11e96785b95c39e8294c"
server_key_version: "encryptionkey@0"
I20260807 10:43:53.989089 23948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:54.007951 23948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:54.013022 23948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:54.013357 23948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:54.014612 23948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:54.016292 23948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:54.016417 23948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:54.016573 23948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:54.016633 23948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:54.051820 23948 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:43145
I20260807 10:43:54.051868 24136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:43145 every 8 connection(s)
I20260807 10:43:54.053277 23948 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:54.058341 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 23948
I20260807 10:43:54.058583 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:43:54.059224 11450 external_mini_cluster.cc:1428] Setting key ce11d790c1fca1a3ad188ac9e236e548
Aug 07 10:43:54 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099433, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:54.076496 24140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:54.056250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:54889 (local address 127.11.46.190:42791)
0807 10:43:54.056763 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:54.056768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:54.057787 (+ 1019us) server_negotiation.cc:407] Connection header received
0807 10:43:54.060087 (+ 2300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:54.060094 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:54.060214 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:54.060347 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:54.062498 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:54.063261 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:54.065155 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:54.065655 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:54.065788 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:54.069867 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:54.069874 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:54.069877 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:54.069938 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:54.072692 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:54.073713 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:54.073719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:54.073721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:54.073879 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:54.074412 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:54.074416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:54.074419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:54.074744 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:54.074904 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:54.075923 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0807 10:43:54.076176 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":284,"threads_started":1}
I20260807 10:43:54.077957 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:54.056738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:54889)
0807 10:43:54.057595 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:54.057650 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:54.059680 (+ 2030us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:54.060659 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:54.060672 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:54.061600 (+ 928us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:54.062291 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:54.062314 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:54.063472 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:54.063476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:54.064980 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:54.064998 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:54.065951 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:54.065960 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:54.066220 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:54.066953 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:54.066985 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:54.069558 (+ 2573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:54.072916 (+ 3358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:54.072928 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:54.072946 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:54.073553 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:54.074008 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:54.074014 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:54.074018 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:54.074263 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:54.074910 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:54.074920 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:54.075399 (+ 479us) client_negotiation.cc:769] Sending connection context
0807 10:43:54.075772 (+ 373us) client_negotiation.cc:240] Negotiation successful
0807 10:43:54.076484 (+ 712us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":316,"threads_started":1}
I20260807 10:43:54.079891 24137 heartbeater.cc:347] Connected to a master server at 127.11.46.190:42791
I20260807 10:43:54.080260 24137 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:54.081190 24137 heartbeater.cc:511] Master 127.11.46.190:42791 requested a full tablet report, sending...
I20260807 10:43:54.084209 23855 ts_manager.cc:194] Registered new tserver with Master: 6a38a9647b5b490782a639552b5b3c70 (127.11.46.129:43145)
I20260807 10:43:54.085947 23855 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:54889
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:43:54.132656 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42791
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:54.528887 24145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:54.529237 24145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:54.529340 24145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:54.537194 24145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:54.537334 24145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:54.537484 24145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:54.548331 24145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:54.549889 24145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:54.551368 24145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:54.566761 24156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:54.566740 24158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:54.567239 24160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:54.567800 24145 server_base.cc:1034] running on GCE node
I20260807 10:43:54.568499 24145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:54.569655 24145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:54.570884 24145 hybrid_clock.cc:648] HybridClock initialized: now 1786099434570821 us; error 44 us; skew 500 ppm
I20260807 10:43:54.571274 24145 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:54 dist-test-slave-42z9 krb5kdc[23779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099434, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:54.574922 24145 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:43:54.576701 24145 webserver.cc:460] Webserver started at http://127.11.46.130:44361/ using document root <none> and password file <none>
I20260807 10:43:54.577595 24145 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:54.577733 24145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:54.578090 24145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:54.581677 24145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "bebb0d57da20405c8427edb5dd4e8d6e"
format_stamp: "Formatted at 2026-08-07 10:43:54 on dist-test-slave-42z9"
server_key: "895a37df93a36e8c09997621e595b9ff"
server_key_iv: "8294cd65acf24b0363b049be32bcdab1"
server_key_version: "encryptionkey@0"
I20260807 10:43:54.582675 24145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "bebb0d57da20405c8427edb5dd4e8d6e"
format_stamp: "Formatted at 2026-08-07 10:43:54 on dist-test-slave-42z9"
server_key: "895a37df93a36e8c09997621e595b9ff"
server_key_iv: "8294cd65acf24b0363b049be32bcdab1"
server_key_version: "encryptionkey@0"
I20260807 10:43:54.589056 24145 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260807 10:43:54.593549 24168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:54.595329 24145 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:54.595561 24145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "bebb0d57da20405c8427edb5dd4e8d6e"
format_stamp: "Formatted at 2026-08-07 10:43:54 on dist-test-slave-42z9"
server_key: "895a37df93a36e8c09997621e595b9ff"
server_key_iv: "8294cd65acf24b0363b049be32bcdab1"
server_key_version: "encryptionkey@0"
I20260807 10:43:54.595822 24145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:54.620429 24145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:54.625659 24145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:54.625983 24145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:54.627213 24145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:54.628842 24145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:54.628931 24145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:54.629060 24145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:54.629113 24145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:54.665355 24145 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:45025
I20260807 10:43:54.665409 24357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:45025 every 8 connection(s)
I20260807 10:43:54.666970 24145 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:54.668718 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 24145
I20260807 10:43:54.668954 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:43:54.669608 11450 external_mini_cluster.cc:1428] Setting key a3701df5b98944a623b35c0bcfbf93d5
Aug 07 10:43:54 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099434, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:54.690663 24363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:54.670262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:43849 (local address 127.11.46.190:42791)
0807 10:43:54.670813 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:54.670818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:54.672043 (+ 1225us) server_negotiation.cc:407] Connection header received
0807 10:43:54.674201 (+ 2158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:54.674207 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:54.674303 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:54.674405 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:54.676287 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:54.677059 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:54.678933 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:54.679425 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:54.679554 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:54.683618 (+ 4064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:54.683625 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:54.683628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:54.683670 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:54.686818 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:54.687789 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:54.687794 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:54.687797 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:54.687967 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:54.688512 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:54.688517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:54.688519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:54.688845 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:54.689010 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:54.689976 (+ 966us) server_negotiation.cc:299] Negotiation successful
0807 10:43:54.690274 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":294,"threads_started":1}
I20260807 10:43:54.691833 24364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:54.670898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:43849)
0807 10:43:54.671879 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:54.671929 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:54.673871 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:54.674735 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:54.674745 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:54.675347 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:54.676063 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:54.676087 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:54.677254 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:54.677258 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:54.678756 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:54.678775 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:54.679722 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:54.679731 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:54.680030 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:54.680799 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:54.680828 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:54.683307 (+ 2479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:54.687031 (+ 3724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:54.687041 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:54.687060 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:54.687619 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:54.688105 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:54.688110 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:54.688112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:54.688367 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:54.689005 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:54.689015 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:54.689513 (+ 498us) client_negotiation.cc:769] Sending connection context
0807 10:43:54.689817 (+ 304us) client_negotiation.cc:240] Negotiation successful
0807 10:43:54.690505 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":350,"threads_started":1}
I20260807 10:43:54.693658 24361 heartbeater.cc:347] Connected to a master server at 127.11.46.190:42791
I20260807 10:43:54.694061 24361 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:54.694931 24361 heartbeater.cc:511] Master 127.11.46.190:42791 requested a full tablet report, sending...
I20260807 10:43:54.696833 23855 ts_manager.cc:194] Registered new tserver with Master: bebb0d57da20405c8427edb5dd4e8d6e (127.11.46.130:45025)
I20260807 10:43:54.698132 23855 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:43849
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:43:54.741011 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42791
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:43:55.089644 24137 heartbeater.cc:503] Master 127.11.46.190:42791 was elected leader, sending a full tablet report...
W20260807 10:43:55.119856 24370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:55.120198 24370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:55.120375 24370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:55.128608 24370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:55.128762 24370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:55.128932 24370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:55.139554 24370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:55.141086 24370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:55.142658 24370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:55.158391 24379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:55.159073 24378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:55.159734 24370 server_base.cc:1034] running on GCE node
W20260807 10:43:55.159822 24383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:55.160670 24370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:55.161834 24370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:55.163056 24370 hybrid_clock.cc:648] HybridClock initialized: now 1786099435162996 us; error 67 us; skew 500 ppm
I20260807 10:43:55.163406 24370 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:55 dist-test-slave-42z9 krb5kdc[23779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099435, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:55.166807 24370 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:43:55.168419 24370 webserver.cc:460] Webserver started at http://127.11.46.131:40241/ using document root <none> and password file <none>
I20260807 10:43:55.169298 24370 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:55.169435 24370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:55.169817 24370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:43:55.173290 24370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "1694929724fb44fdb788e6fe0b12adb5"
format_stamp: "Formatted at 2026-08-07 10:43:55 on dist-test-slave-42z9"
server_key: "35324cc249a20385ee73c0f23429f344"
server_key_iv: "b97fcc1eab9874af976c83072615c951"
server_key_version: "encryptionkey@0"
I20260807 10:43:55.174326 24370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "1694929724fb44fdb788e6fe0b12adb5"
format_stamp: "Formatted at 2026-08-07 10:43:55 on dist-test-slave-42z9"
server_key: "35324cc249a20385ee73c0f23429f344"
server_key_iv: "b97fcc1eab9874af976c83072615c951"
server_key_version: "encryptionkey@0"
I20260807 10:43:55.180599 24370 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:43:55.184710 24396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:55.186283 24370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:43:55.186478 24370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "1694929724fb44fdb788e6fe0b12adb5"
format_stamp: "Formatted at 2026-08-07 10:43:55 on dist-test-slave-42z9"
server_key: "35324cc249a20385ee73c0f23429f344"
server_key_iv: "b97fcc1eab9874af976c83072615c951"
server_key_version: "encryptionkey@0"
I20260807 10:43:55.186710 24370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:55.205842 24370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:55.211580 24370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:55.211902 24370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:55.213023 24370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:55.214648 24370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:55.214730 24370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:55.214869 24370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:55.214922 24370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:55.249266 24370 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:44701
I20260807 10:43:55.249315 24567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:44701 every 8 connection(s)
I20260807 10:43:55.250819 24370 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:55.259286 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 24370
I20260807 10:43:55.259533 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:43:55.259995 11450 external_mini_cluster.cc:1428] Setting key 1f1866e8638829afc459ead81e03d96e
Aug 07 10:43:55 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099435, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:43:55.275302 24571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:55.253889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:33007 (local address 127.11.46.190:42791)
0807 10:43:55.254441 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:55.254447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:55.255669 (+ 1222us) server_negotiation.cc:407] Connection header received
0807 10:43:55.257800 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:55.257807 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:55.257906 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:55.258019 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:55.260019 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:55.260974 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:55.263255 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:55.263756 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:55.263909 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:55.268008 (+ 4099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:55.268015 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:55.268018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:55.268061 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:55.271293 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:55.272316 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:55.272322 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:55.272324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:55.272498 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:55.273049 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:55.273055 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:55.273057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:55.273393 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:55.273639 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:55.274551 (+ 912us) server_negotiation.cc:299] Negotiation successful
0807 10:43:55.274854 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":292,"threads_started":1}
I20260807 10:43:55.276412 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:55.254563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:33007)
0807 10:43:55.255458 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:55.255513 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:55.257390 (+ 1877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:55.258335 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:55.258346 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:55.259004 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:55.259778 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:55.259803 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:55.261209 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:55.261215 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:55.263047 (+ 1832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:55.263073 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:55.264042 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:55.264049 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:55.264300 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:55.265066 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:55.265094 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:55.267696 (+ 2602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:43:55.271525 (+ 3829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:55.271535 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:55.271556 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:55.272144 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:55.272629 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:43:55.272634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:43:55.272637 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:43:55.272894 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:43:55.273594 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:43:55.273604 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:43:55.274062 (+ 458us) client_negotiation.cc:769] Sending connection context
0807 10:43:55.274350 (+ 288us) client_negotiation.cc:240] Negotiation successful
0807 10:43:55.275041 (+ 691us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":339,"threads_started":1}
I20260807 10:43:55.277921 24568 heartbeater.cc:347] Connected to a master server at 127.11.46.190:42791
I20260807 10:43:55.278297 24568 heartbeater.cc:464] Registering TS with master...
I20260807 10:43:55.279161 24568 heartbeater.cc:511] Master 127.11.46.190:42791 requested a full tablet report, sending...
I20260807 10:43:55.281093 23855 ts_manager.cc:194] Registered new tserver with Master: 1694929724fb44fdb788e6fe0b12adb5 (127.11.46.131:44701)
I20260807 10:43:55.282083 23855 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:33007
I20260807 10:43:55.290467 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab.
Entry for principal oryx/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab.
WARNING: no policy specified for oryx/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab.
Entry for principal oryx/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab.
WARNING: no policy specified for oryx/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab.
Entry for principal oryx/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab.
I20260807 10:43:55.494325 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 23948
Aug 07 10:43:55 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:43:55.513147 24586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:55.495690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44764 (local address 127.11.46.129:43145)
0807 10:43:55.496364 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:55.496372 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:55.496404 (+ 32us) server_negotiation.cc:407] Connection header received
0807 10:43:55.496474 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:55.496480 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:55.496728 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:55.496868 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:55.498330 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:55.499501 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:55.500862 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:55.501604 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:55.501728 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:55.506240 (+ 4512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:55.506264 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:55.506289 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:55.506345 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:55.509813 (+ 3468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:55.510723 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:55.510734 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:55.510737 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:55.510897 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:55.511296 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:55.511300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:55.511303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:55.511742 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:55.512083 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:55.512421 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 10:43:55.512763 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":340,"threads_started":1}
I20260807 10:43:55.514725 24127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:55.612890 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 23948
I20260807 10:43:55.640280 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 24145
Aug 07 10:43:55 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:43:55.658366 24588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:55.641194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49506 (local address 127.11.46.130:45025)
0807 10:43:55.641780 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:55.641788 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:55.641818 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:43:55.641894 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:55.641901 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:55.642117 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:55.642262 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:55.643586 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:55.644852 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:55.646360 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:55.647025 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:55.647146 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:55.651812 (+ 4666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:55.651833 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:55.651853 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:55.651912 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:55.654933 (+ 3021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:55.655692 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:55.655700 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:55.655702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:55.655851 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:55.656193 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:55.656197 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:55.656199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:55.656616 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:55.656874 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:55.657420 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 10:43:55.658036 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":320,"threads_started":1}
I20260807 10:43:55.659821 24348 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:55.744359 24361 heartbeater.cc:503] Master 127.11.46.190:42791 was elected leader, sending a full tablet report...
I20260807 10:43:55.749665 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 24145
I20260807 10:43:55.780553 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 24370
Aug 07 10:43:55 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:43:55.797971 24591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:55.781608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32986 (local address 127.11.46.131:44701)
0807 10:43:55.782482 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:55.782492 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:55.782537 (+ 45us) server_negotiation.cc:407] Connection header received
0807 10:43:55.782646 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:55.782656 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:55.783092 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:55.783279 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:55.784670 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:55.785816 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:55.787065 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:55.787662 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:55.787765 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:55.792208 (+ 4443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:55.792221 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:55.792238 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:55.792282 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:55.795132 (+ 2850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:55.795939 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:55.795947 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:55.795950 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:55.796089 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:55.796417 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:55.796420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:55.796422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:55.796799 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:55.797050 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:55.797303 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 10:43:55.797586 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":396,"threads_started":1}
I20260807 10:43:55.799371 24560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:55.884850 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 24370
I20260807 10:43:55.910856 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 23804
I20260807 10:43:55.912075 23897 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:43:56.020743 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 23804
I20260807 10:43:56.052454 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:42791
--webserver_interface=127.11.46.190
--webserver_port=41605
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:42791
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:43:56.434547 24598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:56.434888 24598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:56.435042 24598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:56.442673 24598 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:43:56.442835 24598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:56.442922 24598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:56.443014 24598 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:43:56.443077 24598 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:43:56.453722 24598 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:42791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:42791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=41605
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:56.455265 24598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:56.456692 24598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:56.469573 24609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:56.469498 24613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:56.469528 24611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:56.470943 24598 server_base.cc:1034] running on GCE node
I20260807 10:43:56.471928 24598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:56.473681 24598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:56.474913 24598 hybrid_clock.cc:648] HybridClock initialized: now 1786099436474850 us; error 56 us; skew 500 ppm
I20260807 10:43:56.475320 24598 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:56 dist-test-slave-42z9 krb5kdc[23779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099436, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:56.478770 24598 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:43:56.480541 24598 webserver.cc:460] Webserver started at http://127.11.46.190:41605/ using document root <none> and password file <none>
I20260807 10:43:56.481302 24598 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:56.481426 24598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:56.487990 24598 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:43:56.491446 24623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:56.493158 24598 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:43:56.493377 24598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "2bab9ce79d3b43d591b5ea109a9695c6"
format_stamp: "Formatted at 2026-08-07 10:43:53 on dist-test-slave-42z9"
server_key: "d56f1f1f9d53f89f652398d384e449ee"
server_key_iv: "fa28a25e8568c41ebd5e2be4495a3901"
server_key_version: "encryptionkey@0"
I20260807 10:43:56.494581 24598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:56.513372 24598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:56.518332 24598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:56.518656 24598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:56.538983 24598 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:42791
I20260807 10:43:56.539032 24701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:42791 every 8 connection(s)
I20260807 10:43:56.540755 24598 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:43:56.546442 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 24598
I20260807 10:43:56.547320 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:43145
--local_ip_for_outbound_sockets=127.11.46.129
--tserver_master_addrs=127.11.46.190:42791
--webserver_port=41845
--webserver_interface=127.11.46.129
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.46.129
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:43:56.548868 24702 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:43:56.552562 24702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6: Bootstrap starting.
I20260807 10:43:56.574028 24702 log.cc:824] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6: Log is configured to *not* fsync() on all Append() calls
I20260807 10:43:56.584241 24702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:43:56.584823 24702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6: Bootstrap complete.
I20260807 10:43:56.594501 24702 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } }
I20260807 10:43:56.595477 24702 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bab9ce79d3b43d591b5ea109a9695c6, State: Initialized, Role: FOLLOWER
I20260807 10:43:56.596189 24702 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } }
I20260807 10:43:56.596458 24702 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:43:56.596577 24702 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:43:56.596745 24702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:43:56.601408 24702 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } }
I20260807 10:43:56.602051 24702 leader_election.cc:302] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bab9ce79d3b43d591b5ea109a9695c6; no voters:
I20260807 10:43:56.602751 24702 leader_election.cc:288] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 10:43:56.602914 24710 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 10:43:56.604107 24710 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [term 2 LEADER]: Becoming Leader. State: Replica: 2bab9ce79d3b43d591b5ea109a9695c6, State: Running, Role: LEADER
I20260807 10:43:56.604737 24710 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } }
I20260807 10:43:56.605167 24702 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:43:56.607702 24713 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2bab9ce79d3b43d591b5ea109a9695c6. Latest consensus state: current_term: 2 leader_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } } }
I20260807 10:43:56.608110 24713 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:56.608618 24712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bab9ce79d3b43d591b5ea109a9695c6" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42791 } } }
I20260807 10:43:56.608942 24712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6 [sys.catalog]: This master's current role is: LEADER
I20260807 10:43:56.612059 24718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:43:56.619138 24718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:43:56.620883 24718 catalog_manager.cc:1259] Loaded cluster ID: b9a3592557614ddd953e10bbc87aa07f
I20260807 10:43:56.621109 24718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:43:56.625731 24718 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:43:56.627668 24718 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2bab9ce79d3b43d591b5ea109a9695c6: Loaded TSK: 0
I20260807 10:43:56.630015 24718 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 10:43:56.944969 24708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:56.945327 24708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:56.945508 24708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:56.953478 24708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:56.953644 24708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:56.953811 24708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:43:56.964470 24708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.129.keytab
--principal=oryx/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:43145
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=41845
--tserver_master_addrs=127.11.46.190:42791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:56.966066 24708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:56.967563 24708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:56.984053 24756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:56.984354 24762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:56.984225 24755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:56.986038 24708 server_base.cc:1034] running on GCE node
I20260807 10:43:56.986745 24708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:56.987839 24708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:56.989086 24708 hybrid_clock.cc:648] HybridClock initialized: now 1786099436989026 us; error 55 us; skew 500 ppm
I20260807 10:43:56.989487 24708 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:56 dist-test-slave-42z9 krb5kdc[23779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099436, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:56.992969 24708 init.cc:377] Logged in from keytab as oryx/127.11.46.129@KRBTEST.COM (short username oryx)
I20260807 10:43:56.994767 24708 webserver.cc:460] Webserver started at http://127.11.46.129:41845/ using document root <none> and password file <none>
I20260807 10:43:56.995558 24708 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:56.995690 24708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:57.002184 24708 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:43:57.005292 24773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:57.007023 24708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:43:57.007241 24708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "6a38a9647b5b490782a639552b5b3c70"
format_stamp: "Formatted at 2026-08-07 10:43:53 on dist-test-slave-42z9"
server_key: "e43bfdbaebd68b898732a0e3c81ccf62"
server_key_iv: "e1b4e033997b11e96785b95c39e8294c"
server_key_version: "encryptionkey@0"
I20260807 10:43:57.008352 24708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:57.033996 24708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:57.038552 24708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:57.038861 24708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:57.040119 24708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:57.041850 24708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:57.041953 24708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:57.042070 24708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:57.042146 24708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:57.075521 24708 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:43145
I20260807 10:43:57.075584 24934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:43145 every 8 connection(s)
I20260807 10:43:57.077096 24708 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:43:57.082008 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 24708
I20260807 10:43:57.082612 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:45025
--local_ip_for_outbound_sockets=127.11.46.130
--tserver_master_addrs=127.11.46.190:42791
--webserver_port=44361
--webserver_interface=127.11.46.130
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.46.130
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:43:57 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:57 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 10:43:57.473315 24940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:57.473726 24940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:57.473866 24940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:57.481849 24940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:57.481997 24940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:57.482162 24940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:43:57.493414 24940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.130.keytab
--principal=oryx/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:45025
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=44361
--tserver_master_addrs=127.11.46.190:42791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:57.495076 24940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:57.496569 24940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:57.516819 24950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:57.517504 24951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:57.518246 24954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:57.518350 24940 server_base.cc:1034] running on GCE node
I20260807 10:43:57.519238 24940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:57.520552 24940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:57.521811 24940 hybrid_clock.cc:648] HybridClock initialized: now 1786099437521759 us; error 42 us; skew 500 ppm
I20260807 10:43:57.522197 24940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:57 dist-test-slave-42z9 krb5kdc[23779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099437, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:57.526000 24940 init.cc:377] Logged in from keytab as oryx/127.11.46.130@KRBTEST.COM (short username oryx)
I20260807 10:43:57.528316 24940 webserver.cc:460] Webserver started at http://127.11.46.130:44361/ using document root <none> and password file <none>
I20260807 10:43:57.529152 24940 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:57.529309 24940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:57.536356 24940 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 10:43:57.539855 24965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:57.541425 24940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:43:57.541698 24940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "bebb0d57da20405c8427edb5dd4e8d6e"
format_stamp: "Formatted at 2026-08-07 10:43:54 on dist-test-slave-42z9"
server_key: "895a37df93a36e8c09997621e595b9ff"
server_key_iv: "8294cd65acf24b0363b049be32bcdab1"
server_key_version: "encryptionkey@0"
I20260807 10:43:57.542742 24940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:57.559725 24940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:57.564473 24940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:57.564770 24940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:57.566004 24940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:57.567654 24940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:57.567766 24940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:57.567888 24940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:57.567960 24940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:57.607028 24940 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:45025
I20260807 10:43:57.607060 25135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:45025 every 8 connection(s)
I20260807 10:43:57.608703 24940 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:43:57.609493 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 24940
I20260807 10:43:57.610371 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:44701
--local_ip_for_outbound_sockets=127.11.46.131
--tserver_master_addrs=127.11.46.190:42791
--webserver_port=40241
--webserver_interface=127.11.46.131
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.46.131
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:43:57 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:57 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 10:43:58.212569 25141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:43:58.212991 25141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:43:58.213157 25141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:43:58.221661 25141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:43:58.221802 25141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:43:58.221964 25141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:43:58.236799 25141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/krb5kdc/oryx_127.11.46.131.keytab
--principal=oryx/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:44701
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=40241
--tserver_master_addrs=127.11.46.190:42791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:43:58.238782 25141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:43:58.240784 25141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:43:58.262643 25151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:58.265007 25153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:43:58.265895 25150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:43:58.266773 25141 server_base.cc:1034] running on GCE node
I20260807 10:43:58.268025 25141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:43:58.269942 25141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:43:58.271371 25141 hybrid_clock.cc:648] HybridClock initialized: now 1786099438271271 us; error 64 us; skew 500 ppm
I20260807 10:43:58.271947 25141 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099438, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:43:58.278128 25141 init.cc:377] Logged in from keytab as oryx/127.11.46.131@KRBTEST.COM (short username oryx)
I20260807 10:43:58.280326 25141 webserver.cc:460] Webserver started at http://127.11.46.131:40241/ using document root <none> and password file <none>
I20260807 10:43:58.281212 25141 fs_manager.cc:359] Metadata directory not provided
I20260807 10:43:58.281381 25141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:43:58.288087 25141 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 10:43:58.291440 25161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:58.293134 25141 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:43:58.293349 25141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "1694929724fb44fdb788e6fe0b12adb5"
format_stamp: "Formatted at 2026-08-07 10:43:55 on dist-test-slave-42z9"
server_key: "35324cc249a20385ee73c0f23429f344"
server_key_iv: "b97fcc1eab9874af976c83072615c951"
server_key_version: "encryptionkey@0"
I20260807 10:43:58.294580 25141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:43:58.316252 25141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:43:58.321599 25141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:43:58.321915 25141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:43:58.323218 25141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:43:58.324970 25141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:43:58.325086 25141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:43:58.325212 25141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:43:58.325286 25141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20260807 10:43:58.349853 24939 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.258s user 0.004s sys 0.015s
I20260807 10:43:58.352757 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:57.080134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:41401)
0807 10:43:57.080967 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:57.081015 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:57.082963 (+ 1948us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:57.084584 (+ 1621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:57.084592 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:57.085229 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:57.085867 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:57.085887 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:57.087951 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:57.087955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:57.089227 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:57.089242 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:57.090601 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:57.090606 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:57.090813 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:57.091530 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:57.091556 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:58.351173 (+1259617us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":344,"threads_started":1}
W20260807 10:43:58.352851 24938 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:57.080075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:41401 (local address 127.11.46.190:42791)
0807 10:43:57.080778 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:57.080791 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:57.081139 (+ 348us) server_negotiation.cc:407] Connection header received
0807 10:43:57.083552 (+ 2413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:57.083572 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:57.084044 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:57.084477 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:57.086101 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:57.087788 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:57.089388 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:57.090352 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:57.090576 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.351761 (+1261185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:41401: BlockingRecv error: recv got EOF from 127.11.46.129:41401 (error 108)
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":258,"threads_started":1}
W20260807 10:43:58.354955 24936 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:42791 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.46.190:42791: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:43:58.371663 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:58.356098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:46051)
0807 10:43:58.357045 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:58.357073 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:58.357357 (+ 284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:58.358291 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:58.358298 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:58.358923 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:58.359226 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:58.359242 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.361142 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.361149 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:58.363009 (+ 1860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:58.363031 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.364564 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.364572 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:58.364792 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.365728 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:58.365759 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:58.371244 (+ 5485us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":773,"thread_start_us":11514,"threads_started":1}
W20260807 10:43:58.372681 24938 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:58.356239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:46051 (local address 127.11.46.190:42791)
0807 10:43:58.356498 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:58.356506 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:58.357191 (+ 685us) server_negotiation.cc:407] Connection header received
0807 10:43:58.357609 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:58.357617 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:58.357739 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:58.357827 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:58.359532 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.360824 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.363270 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.364017 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.364136 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.372369 (+ 8233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:46051: BlockingRecv error: recv got EOF from 127.11.46.129:46051 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:43:58.388170 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:58.372945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:36369)
0807 10:43:58.373240 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:58.373268 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:58.373465 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:58.374773 (+ 1308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:58.374780 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:58.375377 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:58.375665 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:58.375682 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.377689 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.377697 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:58.379620 (+ 1923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:58.379647 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.381246 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.381254 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:58.381527 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.382472 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:58.382503 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:58.387819 (+ 5316us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121}
W20260807 10:43:58.388743 24936 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 10:43:58.389190 24938 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:58.373902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:36369 (local address 127.11.46.190:42791)
0807 10:43:58.374144 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:58.374152 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:58.374178 (+ 26us) server_negotiation.cc:407] Connection header received
0807 10:43:58.374263 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:58.374269 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:58.374366 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:58.374490 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:58.375933 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.377363 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.379907 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.380748 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.380917 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.388891 (+ 7974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:36369: BlockingRecv error: recv got EOF from 127.11.46.129:36369 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 10:43:58.402323 25141 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:44701
I20260807 10:43:58.402382 25318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:44701 every 8 connection(s)
I20260807 10:43:58.404155 25141 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:43:58.410394 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 25141
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:43:58.438174 25324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:58.411372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59926 (local address 127.11.46.190:42791)
0807 10:43:58.421996 (+ 10624us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:58.422002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:58.422707 (+ 705us) server_negotiation.cc:407] Connection header received
0807 10:43:58.422920 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:58.422924 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:58.423012 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:58.423111 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:58.424860 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.425792 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.427404 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.427842 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.427971 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.430992 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:43:58.431002 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:43:58.431025 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:43:58.431077 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:43:58.434318 (+ 3241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:58.435176 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:58.435185 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:58.435195 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:58.435428 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:43:58.435852 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:43:58.435857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:43:58.435859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:43:58.436431 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:43:58.436791 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0807 10:43:58.437298 (+ 507us) server_negotiation.cc:299] Negotiation successful
0807 10:43:58.437852 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10444,"thread_start_us":10265,"threads_started":1}
W20260807 10:43:58.666139 25138 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.035s user 0.000s sys 0.020s
W20260807 10:43:58.667972 25140 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:57.613686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:42867 (local address 127.11.46.190:42791)
0807 10:43:57.615676 (+ 1990us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:57.615684 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:57.618435 (+ 2751us) server_negotiation.cc:407] Connection header received
0807 10:43:57.621498 (+ 3063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:57.621506 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:57.621636 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:57.621780 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:57.625068 (+ 3288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:57.626432 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:57.629288 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:57.629788 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:57.629929 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.667675 (+1037746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:42867: BlockingRecv error: recv got EOF from 127.11.46.130:42867 (error 108)
Metrics: {"server-negotiator.queue_time_us":1836,"thread_start_us":1728,"threads_started":1}
I20260807 10:43:58.669025 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:57.612865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:42867)
0807 10:43:57.618208 (+ 5343us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:57.618279 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:57.620960 (+ 2681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:57.622482 (+ 1522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:57.622511 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:57.623591 (+ 1080us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:57.624701 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:57.624739 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:57.626784 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:57.626790 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:57.629054 (+ 2264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:57.629076 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:57.630119 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:57.630130 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:57.630406 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:57.631163 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:57.631199 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:58.667447 (+1036248us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":4936,"thread_start_us":4638,"threads_started":1}
W20260807 10:43:58.670120 25136 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:42791 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.46.190:42791: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:43:58.682433 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:58.670903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:32845)
0807 10:43:58.671181 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:58.671210 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:58.671388 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:58.671748 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:58.671754 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:58.672381 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:58.672689 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:58.672707 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.673951 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.673958 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:58.675777 (+ 1819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:58.675803 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.676582 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.676589 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:58.676792 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.677588 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:58.677619 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:58.682179 (+ 4560us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":82}
W20260807 10:43:58.682873 25140 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:58.671184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:32845 (local address 127.11.46.190:42791)
0807 10:43:58.671354 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:58.671359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:58.671381 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:43:58.671524 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:58.671527 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:58.671596 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:58.671681 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:58.672879 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.673763 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.675962 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.676387 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.676487 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.682571 (+ 6084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:32845: BlockingRecv error: recv got EOF from 127.11.46.130:32845 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:58 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:43:58.695248 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:58.683299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:53437)
0807 10:43:58.683479 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:58.683498 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:58.683598 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:58.684380 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:58.684384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:58.684705 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:58.684887 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:58.684897 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.686668 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.686676 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:58.688477 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:58.688502 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.689301 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.689308 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:58.689569 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.690301 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:58.690330 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:58.694923 (+ 4593us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:43:58.695643 25136 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 10:43:58.695834 25140 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:58.683763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:53437 (local address 127.11.46.190:42791)
0807 10:43:58.683974 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:58.683981 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:58.684003 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:43:58.684079 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:58.684086 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:58.684194 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:58.684318 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:58.685031 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.686395 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.688662 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.689135 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.689238 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.695225 (+ 5987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:53437: BlockingRecv error: recv got EOF from 127.11.46.130:53437 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 10:43:59 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:59 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:43:59.406226 25326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:59.389409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:46527)
0807 10:43:59.390083 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:59.390108 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:59.390253 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:59.390693 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:59.390697 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:59.391121 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:59.391283 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:59.391293 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.392774 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.392779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:59.393845 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:59.393863 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.394927 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.394933 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:59.395088 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:59.395737 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:59.395757 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:59.405803 (+ 10046us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":324,"threads_started":1}
W20260807 10:43:59.406991 25329 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:59.389510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:46527 (local address 127.11.46.190:42791)
0807 10:43:59.390366 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:59.390372 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:59.390393 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:43:59.390452 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:59.390458 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:59.390557 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:59.390666 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:59.391426 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.392592 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.394013 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.394710 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.394848 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:59.406146 (+ 11298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:46527: BlockingRecv error: recv got EOF from 127.11.46.129:46527 (error 108)
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":568,"threads_started":1}
W20260807 10:43:59.463399 25321 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.039s user 0.008s sys 0.017s
W20260807 10:43:59.464779 24938 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:58.408202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:57911 (local address 127.11.46.190:42791)
0807 10:43:58.408465 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:58.408472 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:58.410093 (+ 1621us) server_negotiation.cc:407] Connection header received
0807 10:43:58.413829 (+ 3736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:58.413838 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:58.413981 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:58.414071 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:58.417560 (+ 3489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.418855 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.422015 (+ 3160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.422642 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.422792 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:59.464533 (+1041741us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:57911: BlockingRecv error: recv got EOF from 127.11.46.131:57911 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 10:43:59.465638 25321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:58.408586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:57911)
0807 10:43:58.409773 (+ 1187us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:58.409888 (+ 115us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:58.413270 (+ 3382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:58.414958 (+ 1688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:58.414987 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:58.416035 (+ 1048us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:58.417167 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:58.417204 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.419206 (+ 2002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.419213 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:58.421759 (+ 2546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:58.421783 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:58.423189 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:58.423198 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:58.423661 (+ 463us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:58.424684 (+ 1023us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:58.424725 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:59.464368 (+1039643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":411,"threads_started":1}
W20260807 10:43:59.466678 25319 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:42791 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.46.190:42791: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Aug 07 10:43:59 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:59 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:43:59.477032 25321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:59.467649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:37751)
0807 10:43:59.467880 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:59.467900 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:59.468014 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:59.468311 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:59.468314 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:59.468706 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:59.468910 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:59.468921 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.470064 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.470068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:59.471114 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:59.471128 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.472108 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.472197 (+ 89us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:59.472380 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:59.473063 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:59.473084 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:59.476709 (+ 3625us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":90}
W20260807 10:43:59.477229 24938 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:59.467805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:37751 (local address 127.11.46.190:42791)
0807 10:43:59.468046 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:59.468051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:59.468070 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:43:59.468122 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:59.468126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:59.468192 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:59.468272 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:59.469054 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.469928 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.471272 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.471744 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.471852 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:59.476973 (+ 5121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:37751: BlockingRecv error: recv got EOF from 127.11.46.131:37751 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
Aug 07 10:43:59 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:59 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:43:59.486055 25321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:59.477902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:48313)
0807 10:43:59.478088 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:59.478106 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:59.478197 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:59.478469 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:59.478472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:59.478787 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:59.478957 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:59.478966 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.479981 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.479986 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:59.480976 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:59.480989 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.481700 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.481705 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:59.481876 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:59.482407 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:59.482431 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:59.485820 (+ 3389us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 10:43:59.486330 24938 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:59.477966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:48313 (local address 127.11.46.190:42791)
0807 10:43:59.478136 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:59.478140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:59.478159 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:43:59.478278 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:59.478281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:59.478342 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:59.478419 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:59.479069 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.479828 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.481091 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.481571 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.481667 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:59.486087 (+ 4420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:48313: BlockingRecv error: recv got EOF from 127.11.46.131:48313 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260807 10:43:59.486438 25319 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 10:43:59 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:43:59 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:43:59.706348 25330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:43:59.696292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:52179)
0807 10:43:59.696925 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0807 10:43:59.696943 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:43:59.697084 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:43:59.697412 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:43:59.697415 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:43:59.697905 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:43:59.698085 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:59.698096 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.699369 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.699373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:59.700664 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:43:59.700685 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.701692 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.701698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:43:59.701833 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:59.702465 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:43:59.702501 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:43:59.706075 (+ 3574us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":367,"threads_started":1}
W20260807 10:43:59.706624 24938 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:43:59.696451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:52179 (local address 127.11.46.190:42791)
0807 10:43:59.696708 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 10:43:59.696716 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:43:59.697033 (+ 317us) server_negotiation.cc:407] Connection header received
0807 10:43:59.697208 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:43:59.697212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:43:59.697284 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:43:59.697370 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:43:59.698288 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.699196 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.700841 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:43:59.701498 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:43:59.701618 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:43:59.706381 (+ 4763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:52179: BlockingRecv error: recv got EOF from 127.11.46.130:52179 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 10:44:00 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:00 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:00.417049 25331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:00.407424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:54343)
0807 10:44:00.408034 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:00.408059 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:00.408204 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:00.408577 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:00.408582 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:00.409050 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:00.409255 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:00.409266 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.410372 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.410377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:00.411319 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:00.411333 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.412099 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.412106 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:00.412297 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:00.412915 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:00.412936 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:00.416744 (+ 3808us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":322,"threads_started":1}
W20260807 10:44:00.417583 25336 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:00.407508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:54343 (local address 127.11.46.190:42791)
0807 10:44:00.408140 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:00.408146 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:00.408164 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:44:00.408332 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:00.408337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:00.408402 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:00.408494 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:00.409416 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.410216 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.411480 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.411901 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.412017 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:00.416997 (+ 4980us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:54343: BlockingRecv error: recv got EOF from 127.11.46.129:54343 (error 108)
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":378,"threads_started":1}
Aug 07 10:44:00 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:00 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:00.497478 25338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:00.487110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:51917)
0807 10:44:00.487712 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:00.487729 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:00.487869 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:00.488192 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:00.488196 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:00.488688 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:00.488865 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:00.488876 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.490498 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.490504 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:00.491591 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:00.491609 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.492418 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.492423 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:00.492566 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:00.493239 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:00.493261 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:00.497167 (+ 3906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":353,"threads_started":1}
W20260807 10:44:00.497682 25336 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:00.487329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:51917 (local address 127.11.46.190:42791)
0807 10:44:00.487599 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:00.487606 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:00.487816 (+ 210us) server_negotiation.cc:407] Connection header received
0807 10:44:00.487974 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:00.487978 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:00.488060 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:00.488150 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:00.489185 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.490268 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.491755 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.492249 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.492356 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:00.497418 (+ 5062us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:51917: BlockingRecv error: recv got EOF from 127.11.46.131:51917 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 07 10:44:00 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:00 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:00.717833 25339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:00.707396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:48417)
0807 10:44:00.707964 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:00.707997 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:00.708159 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:00.708640 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:00.708645 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:00.709176 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:00.709496 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:00.709514 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.710767 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.710774 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:00.711721 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:00.711746 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.712522 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.712529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:00.712746 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:00.713482 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:00.713506 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:00.717539 (+ 4033us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":284,"threads_started":1}
W20260807 10:44:00.718071 25336 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:00.707700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:48417 (local address 127.11.46.190:42791)
0807 10:44:00.707947 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:00.707954 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:00.708087 (+ 133us) server_negotiation.cc:407] Connection header received
0807 10:44:00.708378 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:00.708383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:00.708470 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:00.708566 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:00.709685 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.710596 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.711890 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:00.712349 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:00.712467 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:00.717803 (+ 5336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:48417: BlockingRecv error: recv got EOF from 127.11.46.130:48417 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 07 10:44:01 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:01 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:01.427589 25342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:01.418275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:41413)
0807 10:44:01.419022 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:01.419047 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:01.419210 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:01.419812 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:01.419817 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:01.420274 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:01.420471 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:01.420483 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.421502 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.421506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:01.422423 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:01.422436 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.423073 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.423077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:01.423210 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:01.423793 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:01.423809 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:01.427309 (+ 3500us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":464,"threads_started":1}
W20260807 10:44:01.427868 25345 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:01.418466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:41413 (local address 127.11.46.190:42791)
0807 10:44:01.419051 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:01.419056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:01.419129 (+ 73us) server_negotiation.cc:407] Connection header received
0807 10:44:01.419323 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:01.419327 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:01.419438 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:01.419555 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:01.420609 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.421343 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.422540 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.422959 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.423053 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:01.427580 (+ 4527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:41413: BlockingRecv error: recv got EOF from 127.11.46.129:41413 (error 108)
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":294,"threads_started":1}
Aug 07 10:44:01 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:01 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:01.508419 25346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:01.498685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:51099)
0807 10:44:01.499243 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:01.499278 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:01.499433 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:01.499792 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:01.499795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:01.500291 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:01.500495 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:01.500505 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.501582 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.501585 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:01.502536 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:01.502550 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.503237 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.503242 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:01.503370 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:01.503998 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:01.504019 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:01.508136 (+ 4117us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":345,"threads_started":1}
W20260807 10:44:01.508553 25345 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:01.498798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:51099 (local address 127.11.46.190:42791)
0807 10:44:01.499067 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:01.499074 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:01.499361 (+ 287us) server_negotiation.cc:407] Connection header received
0807 10:44:01.499591 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:01.499596 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:01.499670 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:01.499759 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:01.500643 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.501421 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.502660 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.503107 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.503203 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:01.508325 (+ 5122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:51099: BlockingRecv error: recv got EOF from 127.11.46.131:51099 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 07 10:44:01 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:01 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:01.727967 25347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:01.718836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:59729)
0807 10:44:01.719309 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:01.719326 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:01.719485 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:01.719817 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:01.719821 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:01.720228 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:01.720404 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:01.720423 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.721517 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.721521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:01.722455 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:01.722470 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.723247 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.723253 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:01.723458 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:01.724078 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:01.724099 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:01.727694 (+ 3595us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":247,"threads_started":1}
W20260807 10:44:01.728176 25345 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:01.718901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:59729 (local address 127.11.46.190:42791)
0807 10:44:01.719085 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:01.719092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:01.719423 (+ 331us) server_negotiation.cc:407] Connection header received
0807 10:44:01.719601 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:01.719605 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:01.719681 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:01.719767 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:01.720558 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.721332 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.722610 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:01.723083 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:01.723204 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:01.727937 (+ 4733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:59729: BlockingRecv error: recv got EOF from 127.11.46.130:59729 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 07 10:44:02 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:02 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:02.438599 25348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:02.428788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:38907)
0807 10:44:02.429336 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:02.429353 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:02.429507 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:02.430073 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:02.430077 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:02.430493 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:02.430672 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:02.430682 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.431747 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.431750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:02.432754 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:02.432768 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.433424 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.433428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:02.433617 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:02.434304 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:02.434331 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:02.438303 (+ 3972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":284,"threads_started":1}
W20260807 10:44:02.438817 25350 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:02.428948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:38907 (local address 127.11.46.190:42791)
0807 10:44:02.429705 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:02.429710 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:02.429729 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:44:02.429785 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:02.429788 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:02.429854 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:02.429957 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:02.430864 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.431635 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.432885 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.433301 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.433398 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:02.438544 (+ 5146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:38907: BlockingRecv error: recv got EOF from 127.11.46.129:38907 (error 108)
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":521,"threads_started":1}
Aug 07 10:44:02 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:02 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:02.519479 25352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:02.509687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:43765)
0807 10:44:02.510509 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:02.510529 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:02.510684 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:02.511029 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:02.511034 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:02.511457 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:02.511633 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:02.511642 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.512793 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.512798 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:02.513923 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:02.513938 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.514785 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.514792 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:02.514995 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:02.515581 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:02.515600 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:02.519183 (+ 3583us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":580,"threads_started":1}
W20260807 10:44:02.519870 25350 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:02.509795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:43765 (local address 127.11.46.190:42791)
0807 10:44:02.510128 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:02.510135 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:02.510635 (+ 500us) server_negotiation.cc:407] Connection header received
0807 10:44:02.510802 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:02.510807 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:02.510881 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:02.510966 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:02.511790 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.512619 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.514095 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.514621 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.514743 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:02.519461 (+ 4718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:43765: BlockingRecv error: recv got EOF from 127.11.46.131:43765 (error 108)
Metrics: {"server-negotiator.queue_time_us":189}
Aug 07 10:44:02 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:02 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:02.739049 25353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:02.729217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:34839)
0807 10:44:02.729838 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:02.729855 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:02.730006 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:02.730392 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:02.730397 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:02.730841 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:02.731036 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:02.731047 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.732358 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.732364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:02.733399 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:02.733415 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.734247 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.734253 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:02.734439 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:02.735044 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:02.735063 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:02.738666 (+ 3603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":359,"threads_started":1}
W20260807 10:44:02.739231 25350 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:02.729357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:34839 (local address 127.11.46.190:42791)
0807 10:44:02.729599 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:02.729605 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:02.729966 (+ 361us) server_negotiation.cc:407] Connection header received
0807 10:44:02.730137 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:02.730143 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:02.730239 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:02.730332 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:02.731211 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.732219 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.733592 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:02.734075 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:02.734200 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:02.738962 (+ 4762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:34839: BlockingRecv error: recv got EOF from 127.11.46.130:34839 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 10:44:03 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:03 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:03.449167 25354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:03.439674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:44207)
0807 10:44:03.440232 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:03.440251 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:03.440368 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:03.440698 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:03.440701 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:03.441187 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:03.441353 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:03.441365 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.442468 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.442473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:03.443437 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:03.443450 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.444194 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.444199 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:03.444344 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:03.444968 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:03.444987 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:03.448779 (+ 3792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":286,"threads_started":1}
W20260807 10:44:03.449368 25355 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:03.439760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:44207 (local address 127.11.46.190:42791)
0807 10:44:03.440282 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:03.440287 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:03.440306 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:44:03.440476 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:03.440479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:03.440556 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:03.440650 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:03.441546 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.442336 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.443589 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.444055 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.444156 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:03.449075 (+ 4919us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:44207: BlockingRecv error: recv got EOF from 127.11.46.129:44207 (error 108)
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":272,"threads_started":1}
Aug 07 10:44:03 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:03 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:03.530429 25358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:03.520727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:60031)
0807 10:44:03.521301 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:03.521318 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:03.521485 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:03.521867 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:03.521871 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:03.522275 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:03.522451 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:03.522460 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.523521 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.523527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:03.524992 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:03.525011 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.525775 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.525782 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:03.525961 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:03.526568 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:03.526587 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:03.530041 (+ 3454us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":314,"threads_started":1}
W20260807 10:44:03.530546 25355 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:03.520878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:60031 (local address 127.11.46.190:42791)
0807 10:44:03.521055 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:03.521059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:03.521419 (+ 360us) server_negotiation.cc:407] Connection header received
0807 10:44:03.521601 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:03.521605 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:03.521674 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:03.521770 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:03.522596 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.523371 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.525141 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.525626 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.525742 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:03.530310 (+ 4568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:60031: BlockingRecv error: recv got EOF from 127.11.46.131:60031 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 10:44:03 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:03 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:03.749765 25359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:03.740212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:43981)
0807 10:44:03.740778 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:03.740799 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:03.740953 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:03.741294 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:03.741299 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:03.741861 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:03.742039 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:03.742051 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.743130 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.743134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:03.744117 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:03.744132 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.744924 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.744930 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:03.745122 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:03.745814 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:03.745835 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:03.749371 (+ 3536us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":291,"threads_started":1}
W20260807 10:44:03.750084 25355 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:03.740504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:43981 (local address 127.11.46.190:42791)
0807 10:44:03.740768 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:03.740774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:03.740888 (+ 114us) server_negotiation.cc:407] Connection header received
0807 10:44:03.741083 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:03.741087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:03.741155 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:03.741243 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:03.742214 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.742974 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.744287 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:03.744753 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:03.744876 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:03.749663 (+ 4787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:43981: BlockingRecv error: recv got EOF from 127.11.46.130:43981 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 07 10:44:04 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:04 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:04.463177 25360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:04.450253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:60373)
0807 10:44:04.450777 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:04.450794 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:04.450909 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:04.451214 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:04.451217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:04.451628 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:04.451816 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:04.451826 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.452821 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.452824 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:04.453818 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:04.453833 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.454485 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.454489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:04.454611 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:04.458956 (+ 4345us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:04.458980 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:04.462920 (+ 3940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":264,"threads_started":1}
W20260807 10:44:04.463400 25362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:04.450326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:60373 (local address 127.11.46.190:42791)
0807 10:44:04.450822 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:04.450827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:04.450845 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:44:04.451017 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:04.451020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:04.451093 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:04.451182 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:04.451938 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.452698 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.453938 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.454347 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.454453 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:04.463165 (+ 8712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:60373: BlockingRecv error: recv got EOF from 127.11.46.129:60373 (error 108)
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":254,"threads_started":1}
Aug 07 10:44:04 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:04 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:04.541148 25363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:04.531543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:60637)
0807 10:44:04.532121 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:04.532138 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:04.532284 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:04.532620 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:04.532626 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:04.533125 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:04.533285 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:04.533296 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.534367 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.534373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:04.535328 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:04.535343 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.536256 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.536263 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:04.536468 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:04.537089 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:04.537109 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:04.540908 (+ 3799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":343,"threads_started":1}
W20260807 10:44:04.541460 25362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:04.531689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:60637 (local address 127.11.46.190:42791)
0807 10:44:04.531937 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:04.531944 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:04.532230 (+ 286us) server_negotiation.cc:407] Connection header received
0807 10:44:04.532413 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:04.532417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:04.532485 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:04.532568 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:04.533472 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.534220 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.535490 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.536100 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.536218 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:04.541203 (+ 4985us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:60637: BlockingRecv error: recv got EOF from 127.11.46.131:60637 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 07 10:44:04 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:04 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:04.760222 25364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:04.750790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:54627)
0807 10:44:04.751413 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:04.751434 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:04.751565 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:04.751897 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:04.751900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:04.752333 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:04.752545 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:04.752556 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.753606 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.753610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:04.754588 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:04.754602 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.755378 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.755384 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:04.755554 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:04.756197 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:04.756217 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:04.759876 (+ 3659us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":372,"threads_started":1}
W20260807 10:44:04.760597 25362 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:04.750946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:54627 (local address 127.11.46.190:42791)
0807 10:44:04.751158 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:04.751164 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:04.751527 (+ 363us) server_negotiation.cc:407] Connection header received
0807 10:44:04.751683 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:04.751687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:04.751770 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:04.751862 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:04.752682 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.753473 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.754763 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:04.755174 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:04.755277 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:04.760135 (+ 4858us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:54627: BlockingRecv error: recv got EOF from 127.11.46.130:54627 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 07 10:44:05 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:05 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:05.473246 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:05.464156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:41901)
0807 10:44:05.464758 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:05.464776 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:05.464900 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:05.465183 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:05.465186 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:05.465686 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:05.465875 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:05.465885 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.466910 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.466913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:05.467912 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:05.467925 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.468647 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.468651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:05.468774 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:05.469404 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:05.469424 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:05.472950 (+ 3526us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":264,"threads_started":1}
W20260807 10:44:05.473599 25365 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:05.464206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:41901 (local address 127.11.46.190:42791)
0807 10:44:05.464759 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:05.464765 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:05.464849 (+ 84us) server_negotiation.cc:407] Connection header received
0807 10:44:05.464993 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:05.464997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:05.465063 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:05.465154 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:05.465998 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.466800 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.468051 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.468498 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.468589 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:05.473221 (+ 4632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:41901: BlockingRecv error: recv got EOF from 127.11.46.129:41901 (error 108)
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":314,"threads_started":1}
Aug 07 10:44:05 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:05 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:05.552845 25367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:05.542282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:46685)
0807 10:44:05.542818 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:05.542838 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:05.542991 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:05.543327 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:05.543331 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:05.543919 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:05.544158 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:05.544172 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.545406 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.545412 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:05.546961 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:05.546979 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.547745 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.547752 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:05.548027 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:05.548764 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:05.548789 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:05.552523 (+ 3734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":256,"threads_started":1}
W20260807 10:44:05.552995 25365 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:05.542454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:46685 (local address 127.11.46.190:42791)
0807 10:44:05.542691 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:05.542697 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:05.542929 (+ 232us) server_negotiation.cc:407] Connection header received
0807 10:44:05.543101 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:05.543105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:05.543175 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:05.543259 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:05.544381 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.545245 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.547124 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.547542 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.547685 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:05.552770 (+ 5085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:46685: BlockingRecv error: recv got EOF from 127.11.46.131:46685 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 07 10:44:05 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:05 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:05.770656 25368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:05.761387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:57861)
0807 10:44:05.762100 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:05.762117 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:05.762241 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:05.762537 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:05.762540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:05.763056 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:05.763277 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:05.763289 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.764316 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.764321 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:05.765298 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:05.765314 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.766022 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.766026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:05.766145 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:05.766782 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:05.766802 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:05.770365 (+ 3563us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":302,"threads_started":1}
W20260807 10:44:05.770891 25365 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:05.761472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:57861 (local address 127.11.46.190:42791)
0807 10:44:05.761739 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:05.761746 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:05.762206 (+ 460us) server_negotiation.cc:407] Connection header received
0807 10:44:05.762334 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:05.762338 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:05.762424 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:05.762507 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:05.763433 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.764175 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.765465 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:05.765896 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:05.765991 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:05.770625 (+ 4634us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:57861: BlockingRecv error: recv got EOF from 127.11.46.130:57861 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
Aug 07 10:44:06 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:06 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:06.483059 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:06.474206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:58727)
0807 10:44:06.474801 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:06.474819 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:06.474952 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:06.475263 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:06.475266 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:06.475684 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:06.475875 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:06.475884 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.476918 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.476921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:06.477961 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:06.477978 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.478698 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.478703 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:06.478822 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:06.479412 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:06.479430 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:06.482793 (+ 3363us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":296,"threads_started":1}
W20260807 10:44:06.483433 25371 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:06.474290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:58727 (local address 127.11.46.190:42791)
0807 10:44:06.474795 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:06.474800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:06.474895 (+ 95us) server_negotiation.cc:407] Connection header received
0807 10:44:06.475054 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:06.475058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:06.475135 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:06.475232 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:06.475996 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.476787 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.478100 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.478539 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.478637 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:06.483161 (+ 4524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:58727: BlockingRecv error: recv got EOF from 127.11.46.129:58727 (error 108)
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":274,"threads_started":1}
Aug 07 10:44:06 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:06 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:06.564142 25372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:06.554165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:40309)
0807 10:44:06.554855 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:06.554873 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:06.555009 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:06.555348 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:06.555352 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:06.555851 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:06.556045 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:06.556057 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.557210 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.557214 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:06.558587 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:06.558610 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.559566 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.559571 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:06.559703 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:06.560295 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:06.560314 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:06.563855 (+ 3541us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":340,"threads_started":1}
W20260807 10:44:06.564363 25371 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:06.554360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:40309 (local address 127.11.46.190:42791)
0807 10:44:06.554577 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:06.554581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:06.554953 (+ 372us) server_negotiation.cc:407] Connection header received
0807 10:44:06.555114 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:06.555118 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:06.555189 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:06.555283 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:06.556190 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.557065 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.558772 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.559390 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.559499 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:06.564105 (+ 4606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:40309: BlockingRecv error: recv got EOF from 127.11.46.131:40309 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 10:44:06 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:06 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:06.781394 25374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:06.771825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:55985)
0807 10:44:06.772431 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:06.772449 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:06.772575 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:06.772895 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:06.772899 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:06.773324 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:06.773581 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:06.773595 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.774747 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.774751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:06.775697 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:06.775710 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.776406 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.776410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:06.776537 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:06.777175 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:06.777195 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:06.781007 (+ 3812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":312,"threads_started":1}
W20260807 10:44:06.781632 25371 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:06.771847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:55985 (local address 127.11.46.190:42791)
0807 10:44:06.772042 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:06.772047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:06.772521 (+ 474us) server_negotiation.cc:407] Connection header received
0807 10:44:06.772672 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:06.772676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:06.772767 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:06.772860 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:06.773716 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.774620 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.775822 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:06.776256 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:06.776351 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:06.781337 (+ 4986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:55985: BlockingRecv error: recv got EOF from 127.11.46.130:55985 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 07 10:44:07 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:07 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:07.494383 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:07.484286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:33305)
0807 10:44:07.484905 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:07.484924 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:07.485059 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:07.485397 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:07.485400 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:07.485889 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:07.486098 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:07.486111 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.487229 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.487234 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:07.488345 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:07.488367 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.489322 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.489327 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:07.489549 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:07.490237 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:07.490257 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:07.494022 (+ 3765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":344,"threads_started":1}
W20260807 10:44:07.494624 25376 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:07.484374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:33305 (local address 127.11.46.190:42791)
0807 10:44:07.484935 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:07.484939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:07.485007 (+ 68us) server_negotiation.cc:407] Connection header received
0807 10:44:07.485182 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:07.485186 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:07.485252 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:07.485368 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:07.486259 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.487067 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.488521 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.489138 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.489279 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:07.494333 (+ 5054us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:33305: BlockingRecv error: recv got EOF from 127.11.46.129:33305 (error 108)
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":294,"threads_started":1}
Aug 07 10:44:07 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:07 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:07.574628 25377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:07.565278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:50779)
0807 10:44:07.565872 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:07.565889 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:07.566029 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:07.566364 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:07.566368 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:07.566859 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:07.567043 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:07.567052 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.568167 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.568173 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:07.569131 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:07.569143 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.569955 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.569962 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:07.570126 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:07.570779 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:07.570799 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:07.574335 (+ 3536us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":331,"threads_started":1}
W20260807 10:44:07.574801 25376 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:07.565363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:50779 (local address 127.11.46.190:42791)
0807 10:44:07.565605 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:07.565611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:07.565978 (+ 367us) server_negotiation.cc:407] Connection header received
0807 10:44:07.566157 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:07.566160 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:07.566225 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:07.566305 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:07.567199 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.568010 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.569285 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.569758 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.569876 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:07.574586 (+ 4710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:50779: BlockingRecv error: recv got EOF from 127.11.46.131:50779 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 07 10:44:07 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:07 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:07.792398 25379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:07.782808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:41199)
0807 10:44:07.783381 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:07.783398 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:07.783551 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:07.783920 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:07.783925 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:07.784394 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:07.784556 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:07.784567 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.785641 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.785645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:07.786620 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:07.786635 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.787390 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.787396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:07.787569 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:07.788207 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:07.788231 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:07.792154 (+ 3923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":294,"threads_started":1}
W20260807 10:44:07.792629 25376 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:07.782922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:41199 (local address 127.11.46.190:42791)
0807 10:44:07.783136 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:07.783143 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:07.783502 (+ 359us) server_negotiation.cc:407] Connection header received
0807 10:44:07.783678 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:07.783682 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:07.783768 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:07.783856 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:07.784717 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.785501 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.786775 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:07.787217 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:07.787333 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:07.792346 (+ 5013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:41199: BlockingRecv error: recv got EOF from 127.11.46.130:41199 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 10:44:08 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:08 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 10:44:08.506307 25381 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:08.495769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:36653 (local address 127.11.46.190:42791)
0807 10:44:08.496327 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:08.496332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:08.496361 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:44:08.496529 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:08.496534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:08.496616 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:08.496717 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:08.497626 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.498438 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.499892 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.500300 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.500390 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:08.506019 (+ 5629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:36653: BlockingRecv error: recv got EOF from 127.11.46.129:36653 (error 108)
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":305,"threads_started":1}
I20260807 10:44:08.506656 25380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:08.495638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:36653)
0807 10:44:08.496250 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:08.496271 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:08.496409 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:08.496776 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:08.496782 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:08.497247 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:08.497479 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:08.497495 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.498593 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.498597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:08.499769 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:08.499784 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.500423 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.500429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:08.500581 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:08.501252 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:08.501280 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:08.505598 (+ 4318us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":321,"threads_started":1}
Aug 07 10:44:08 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:08 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:08.592840 25382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:08.575740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:36581)
0807 10:44:08.576383 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:08.576405 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:08.576558 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:08.576996 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:08.577002 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:08.577643 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:08.577863 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:08.577877 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.580430 (+ 2553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.580436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:08.581913 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:08.581933 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.582754 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.582761 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:08.582948 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:08.588377 (+ 5429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:08.588403 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:08.592501 (+ 4098us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":318,"threads_started":1}
W20260807 10:44:08.593024 25381 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:08.575807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:36581 (local address 127.11.46.190:42791)
0807 10:44:08.576036 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:08.576044 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:08.576526 (+ 482us) server_negotiation.cc:407] Connection header received
0807 10:44:08.576738 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:08.576742 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:08.576818 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:08.576931 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:08.579130 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.580245 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.582111 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.582602 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.582712 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:08.592775 (+ 10063us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:36581: BlockingRecv error: recv got EOF from 127.11.46.131:36581 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 10:44:08 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:08 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:08.803722 25383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:08.793591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:49523)
0807 10:44:08.794272 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:08.794289 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:08.794441 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:08.794836 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:08.794841 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:08.795260 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:08.795443 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:08.795454 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.796546 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.796551 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:08.797618 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:08.797636 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.798483 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.798490 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:08.798681 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:08.799500 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:08.799522 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:08.803357 (+ 3835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":441,"threads_started":1}
W20260807 10:44:08.803856 25381 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:08.793776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:49523 (local address 127.11.46.190:42791)
0807 10:44:08.794027 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:08.794034 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:08.794390 (+ 356us) server_negotiation.cc:407] Connection header received
0807 10:44:08.794584 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:08.794590 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:08.794675 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:08.794763 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:08.795616 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.796370 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.797781 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:08.798288 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:08.798431 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:08.803600 (+ 5169us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:49523: BlockingRecv error: recv got EOF from 127.11.46.130:49523 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 07 10:44:09 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:09 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:09.521219 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:09.507802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:60727)
0807 10:44:09.508352 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:09.508369 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:09.508484 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:09.508917 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:09.508921 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:09.509423 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:09.509671 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:09.509686 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.510947 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.510951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:09.511879 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:09.511892 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.512604 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.512610 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:09.512740 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:09.517506 (+ 4766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:09.517529 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:09.520959 (+ 3430us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":288,"threads_started":1}
W20260807 10:44:09.521661 25386 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:09.507971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:60727 (local address 127.11.46.190:42791)
0807 10:44:09.508561 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:09.508565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:09.508606 (+ 41us) server_negotiation.cc:407] Connection header received
0807 10:44:09.508673 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:09.508678 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:09.508766 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:09.508918 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:09.509839 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.510808 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.511995 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.512430 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.512542 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:09.521312 (+ 8770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:60727: BlockingRecv error: recv got EOF from 127.11.46.129:60727 (error 108)
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":327,"threads_started":1}
Aug 07 10:44:09 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:09 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:09.603385 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:09.593937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:49997)
0807 10:44:09.594592 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:09.594609 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:09.594758 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:09.595113 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:09.595118 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:09.595545 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:09.595714 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:09.595724 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.596999 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.597005 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:09.598161 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:09.598175 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.598903 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.598910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:09.599062 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:09.599724 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:09.599744 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:09.603126 (+ 3382us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":378,"threads_started":1}
W20260807 10:44:09.603747 25386 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:09.594118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:49997 (local address 127.11.46.190:42791)
0807 10:44:09.594344 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:09.594351 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:09.594711 (+ 360us) server_negotiation.cc:407] Connection header received
0807 10:44:09.594884 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:09.594888 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:09.594963 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:09.595047 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:09.595872 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.596855 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.598290 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.598769 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.598899 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:09.603344 (+ 4445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:49997: BlockingRecv error: recv got EOF from 127.11.46.131:49997 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 10:44:09 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:09 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:09.814898 25389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:09.804966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:38183)
0807 10:44:09.805678 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:09.805699 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:09.805852 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:09.806258 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:09.806263 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:09.806778 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:09.806993 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:09.807005 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.808255 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.808260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:09.809564 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:09.809585 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.810305 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.810310 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:09.810447 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:09.811052 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:09.811074 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:09.814635 (+ 3561us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":432,"threads_started":1}
W20260807 10:44:09.815260 25386 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:09.805165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:38183 (local address 127.11.46.190:42791)
0807 10:44:09.805384 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:09.805391 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:09.805789 (+ 398us) server_negotiation.cc:407] Connection header received
0807 10:44:09.805993 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:09.805997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:09.806087 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:09.806192 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:09.807150 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.808109 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.809717 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:09.810158 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:09.810269 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:09.814862 (+ 4593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:38183: BlockingRecv error: recv got EOF from 127.11.46.130:38183 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 10:44:10 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:10 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:10.532322 25390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:10.522385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:57873)
0807 10:44:10.523135 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:10.523153 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:10.523284 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:10.523640 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:10.523644 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:10.524103 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:10.524298 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:10.524308 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.525408 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.525413 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:10.526411 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:10.526426 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.527259 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.527266 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:10.527430 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:10.528095 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:10.528117 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:10.531992 (+ 3875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":319,"threads_started":1}
W20260807 10:44:10.532541 25391 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:10.522484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:57873 (local address 127.11.46.190:42791)
0807 10:44:10.523133 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:10.523137 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:10.523229 (+ 92us) server_negotiation.cc:407] Connection header received
0807 10:44:10.523379 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:10.523383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:10.523457 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:10.523550 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:10.524462 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.525250 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.526587 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.527053 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.527166 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:10.532286 (+ 5120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:57873: BlockingRecv error: recv got EOF from 127.11.46.129:57873 (error 108)
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":420,"threads_started":1}
Aug 07 10:44:10 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:10 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:10.614980 25393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:10.604582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:43615)
0807 10:44:10.605169 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:10.605192 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:10.605368 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:10.605772 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:10.605777 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:10.606229 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:10.606509 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:10.606523 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.607925 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.607932 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:10.609138 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:10.609156 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.610161 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.610166 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:10.610303 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:10.610953 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:10.610974 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:10.614718 (+ 3744us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":319,"threads_started":1}
W20260807 10:44:10.615343 25391 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:10.604747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:43615 (local address 127.11.46.190:42791)
0807 10:44:10.604989 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:10.604995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:10.605278 (+ 283us) server_negotiation.cc:407] Connection header received
0807 10:44:10.605538 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:10.605543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:10.605618 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:10.605716 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:10.606753 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.607739 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.609303 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.609993 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.610145 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:10.614964 (+ 4819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:43615: BlockingRecv error: recv got EOF from 127.11.46.131:43615 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 07 10:44:10 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:10 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:10.825711 25394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:10.816031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:37891)
0807 10:44:10.816801 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:10.816822 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:10.816986 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:10.817395 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:10.817401 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:10.818034 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:10.818274 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:10.818289 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.819378 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.819383 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:10.820341 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:10.820355 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.821041 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.821045 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:10.821179 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:10.821812 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:10.821832 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:10.825379 (+ 3547us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":497,"threads_started":1}
W20260807 10:44:10.825907 25391 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:10.816119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:37891 (local address 127.11.46.190:42791)
0807 10:44:10.816360 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:10.816367 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:10.816929 (+ 562us) server_negotiation.cc:407] Connection header received
0807 10:44:10.817103 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:10.817108 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:10.817226 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:10.817335 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:10.818406 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.819209 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.820460 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:10.820886 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:10.820986 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:10.825674 (+ 4688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:37891: BlockingRecv error: recv got EOF from 127.11.46.130:37891 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 07 10:44:11 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:11 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:11.542824 25396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:11.533328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:49203)
0807 10:44:11.533887 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:11.533906 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:11.534027 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:11.534331 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:11.534334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:11.534780 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:11.534945 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:11.534957 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.535996 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.536001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:11.536976 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:11.536994 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.537734 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.537738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:11.537871 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:11.538472 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:11.538489 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:11.542462 (+ 3973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":279,"threads_started":1}
W20260807 10:44:11.543215 25397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:11.533493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:49203 (local address 127.11.46.190:42791)
0807 10:44:11.534011 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:11.534015 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:11.534033 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:44:11.534128 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:11.534131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:11.534206 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:11.534296 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:11.535075 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.535813 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.537107 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.537617 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.537714 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:11.542775 (+ 5061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:49203: BlockingRecv error: recv got EOF from 127.11.46.129:49203 (error 108)
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":272,"threads_started":1}
Aug 07 10:44:11 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:11 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:11.625674 25398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:11.616108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:54711)
0807 10:44:11.616734 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:11.616751 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:11.616886 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:11.617210 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:11.617214 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:11.617806 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:11.618041 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:11.618055 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.619246 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.619251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:11.620364 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:11.620380 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.621155 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.621160 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:11.621303 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:11.621969 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:11.621988 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:11.625356 (+ 3368us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":322,"threads_started":1}
W20260807 10:44:11.625841 25397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:11.616218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:54711 (local address 127.11.46.190:42791)
0807 10:44:11.616421 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:11.616427 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:11.616845 (+ 418us) server_negotiation.cc:407] Connection header received
0807 10:44:11.617015 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:11.617019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:11.617091 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:11.617171 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:11.618204 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.619087 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.620538 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.620987 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.621098 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:11.625624 (+ 4526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:54711: BlockingRecv error: recv got EOF from 127.11.46.131:54711 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 10:44:11 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:11 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:11.836869 25399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:11.826895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:49703)
0807 10:44:11.827466 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:11.827485 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:11.827627 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:11.827985 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:11.827988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:11.828439 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:11.828632 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:11.828643 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.829772 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.829776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:11.830742 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:11.830757 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.831686 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.831693 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:11.831877 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:11.832567 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:11.832589 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:11.836526 (+ 3937us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":291,"threads_started":1}
W20260807 10:44:11.837086 25397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:11.827205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:49703 (local address 127.11.46.190:42791)
0807 10:44:11.827468 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:11.827474 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:11.827574 (+ 100us) server_negotiation.cc:407] Connection header received
0807 10:44:11.827737 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:11.827742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:11.827833 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:11.827926 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:11.828774 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.829643 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.830928 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:11.831499 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:11.831627 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:11.836805 (+ 5178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:49703: BlockingRecv error: recv got EOF from 127.11.46.130:49703 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 07 10:44:12 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:12 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.129@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:12.554214 25400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:12.544200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.129:50919)
0807 10:44:12.545207 (+ 1007us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:12.545224 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:12.545377 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:12.545753 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:12.545759 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:12.546239 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:12.546459 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:12.546472 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.547794 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.547799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:12.548793 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:12.548808 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.549580 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.549585 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:12.549730 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:12.550379 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:12.550401 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:12.553943 (+ 3542us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":863,"thread_start_us":736,"threads_started":1}
W20260807 10:44:12.554464 25402 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:12.544282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:50919 (local address 127.11.46.190:42791)
0807 10:44:12.545088 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:12.545094 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:12.545307 (+ 213us) server_negotiation.cc:407] Connection header received
0807 10:44:12.545518 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:12.545524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:12.545594 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:12.545689 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:12.546631 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.547589 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.548947 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.549413 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.549550 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:12.554233 (+ 4683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.129:50919: BlockingRecv error: recv got EOF from 127.11.46.129:50919 (error 108)
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":369,"threads_started":1}
Aug 07 10:44:12 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:12 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.131@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:12.636034 25403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:12.626923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.131:37651)
0807 10:44:12.627412 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:12.627429 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:12.627554 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:12.627842 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:12.627845 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:12.628277 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:12.628446 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:12.628456 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.629715 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.629719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:12.630789 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:12.630805 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.631459 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.631463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:12.631589 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:12.632154 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:12.632172 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:12.635684 (+ 3512us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":251,"threads_started":1}
W20260807 10:44:12.636175 25402 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:12.627059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:37651 (local address 127.11.46.190:42791)
0807 10:44:12.627357 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:12.627361 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:12.627500 (+ 139us) server_negotiation.cc:407] Connection header received
0807 10:44:12.627647 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:12.627651 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:12.627718 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:12.627808 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:12.628578 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.629560 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.630927 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.631344 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.631451 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:12.635940 (+ 4489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.131:37651: BlockingRecv error: recv got EOF from 127.11.46.131:37651 (error 108)
Metrics: {"server-negotiator.queue_time_us":179}
Aug 07 10:44:12 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 10:44:12 dist-test-slave-42z9 krb5kdc[23779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.46.130@KRBTEST.COM for oryx/127.11.46.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 10:44:12.848073 25404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:12.838422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42791 (local address 127.11.46.130:57377)
0807 10:44:12.838991 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:12.839009 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:12.839129 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:12.839524 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:12.839530 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:12.840055 (+ 525us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:12.840300 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:12.840317 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.841356 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.841362 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:12.842480 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:12.842497 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.843240 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.843245 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:12.843444 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:12.844061 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:12.844081 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:12.847701 (+ 3620us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.46.190:42791: Server oryx/127.11.46.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":295,"threads_started":1}
W20260807 10:44:12.848413 25402 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:12.838496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:57377 (local address 127.11.46.190:42791)
0807 10:44:12.838683 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:12.838689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:12.839082 (+ 393us) server_negotiation.cc:407] Connection header received
0807 10:44:12.839242 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:12.839246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:12.839360 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:12.839475 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:12.840448 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.841201 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.842642 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:12.843084 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:12.843200 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:12.847960 (+ 4760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.46.130:57377: BlockingRecv error: recv got EOF from 127.11.46.130:57377 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 10:44:13.422067 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 24708
I20260807 10:44:13.435449 25408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:13.423302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37290 (local address 127.11.46.129:43145)
0807 10:44:13.423938 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:13.423945 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:13.423975 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:44:13.424047 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:13.424055 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:13.424303 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:13.424485 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:13.426043 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:13.427109 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:13.428309 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:13.428921 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:13.429041 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:13.431696 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:13.431707 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:13.431725 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:13.431776 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:13.434806 (+ 3030us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.46.129@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 10:44:13.435177 (+ 371us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37290: Request ticket server kudu/127.11.46.129@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":310,"threads_started":1}
W20260807 10:44:13.435565 25408 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37290: Request ticket server kudu/127.11.46.129@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 10:44:13.435848 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 24708: Not authorized: Client connection negotiation failed: client connection to 127.11.46.129:43145: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.46.129@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 10:44:13.436053 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 24708
I20260807 10:44:13.469187 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 24940
I20260807 10:44:13.486261 25410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:13.470434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39926 (local address 127.11.46.130:45025)
0807 10:44:13.471065 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:13.471075 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:13.471113 (+ 38us) server_negotiation.cc:407] Connection header received
0807 10:44:13.471281 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:13.471290 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:13.471679 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:13.471918 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:13.473280 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:13.474729 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:13.476097 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:13.476751 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:13.476877 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:13.479829 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:13.479841 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:13.479859 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:13.479920 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:13.485605 (+ 5685us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.46.130@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 10:44:13.486008 (+ 403us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39926: Request ticket server kudu/127.11.46.130@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":255,"threads_started":1}
W20260807 10:44:13.486495 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 24940: Not authorized: Client connection negotiation failed: client connection to 127.11.46.130:45025: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.46.130@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 10:44:13.486672 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 24940
I20260807 10:44:13.522408 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 25141
I20260807 10:44:13.536659 25411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:13.523672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45214 (local address 127.11.46.131:44701)
0807 10:44:13.524376 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:13.524387 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:13.524421 (+ 34us) server_negotiation.cc:407] Connection header received
0807 10:44:13.524505 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:13.524515 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:13.524831 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:13.525050 (+ 219us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:13.526579 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:13.528045 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:13.529279 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:13.529974 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:13.530095 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:13.532910 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:13.532920 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:13.532940 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:13.533014 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:13.536021 (+ 3007us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.46.131@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 10:44:13.536390 (+ 369us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45214: Request ticket server kudu/127.11.46.131@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":318,"threads_started":1}
W20260807 10:44:13.536769 25411 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45214: Request ticket server kudu/127.11.46.131@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 10:44:13.536846 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 25141: Not authorized: Client connection negotiation failed: client connection to 127.11.46.131:44701: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.11.46.131@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 10:44:13.537099 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 25141
I20260807 10:44:13.566452 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 24598
I20260807 10:44:13.567782 24694 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:13.692569 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 24598
2026-08-07T10:44:13Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22453 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T10:44:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:44:13Z Disabled control of system clock
I20260807 10:44:13.805346 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:37461
--webserver_interface=127.11.46.190
--webserver_port=0
--builtin_ntp_servers=127.11.46.148:39715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:37461
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 10:44:14.182066 25419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:14.182410 25419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:14.182548 25419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:14.191371 25419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:44:14.191535 25419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:14.191598 25419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:14.191685 25419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:44:14.191740 25419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:44:14.201785 25419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:37461
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:37461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:14.203362 25419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:14.205422 25419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:14.219084 25433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:14.219595 25430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:14.219640 25438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:14.219901 25419 server_base.cc:1034] running on GCE node
I20260807 10:44:14.220844 25419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:14.222527 25419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:14.223762 25419 hybrid_clock.cc:648] HybridClock initialized: now 1786099454223711 us; error 36 us; skew 500 ppm
I20260807 10:44:14.224171 25419 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:44:14.226789 25419 webserver.cc:460] Webserver started at http://127.11.46.190:34017/ using document root <none> and password file <none>
I20260807 10:44:14.227607 25419 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:14.227717 25419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:14.228087 25419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:14.231441 25419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "a817823b578c4315a020f975a3830b44"
format_stamp: "Formatted at 2026-08-07 10:44:14 on dist-test-slave-42z9"
server_key: "0c423aaea99282e5b2367dca06de1596"
server_key_iv: "8cb3bbbe92e2d14650d63a014cc2c0ad"
server_key_version: "encryptionkey@0"
I20260807 10:44:14.232364 25419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "a817823b578c4315a020f975a3830b44"
format_stamp: "Formatted at 2026-08-07 10:44:14 on dist-test-slave-42z9"
server_key: "0c423aaea99282e5b2367dca06de1596"
server_key_iv: "8cb3bbbe92e2d14650d63a014cc2c0ad"
server_key_version: "encryptionkey@0"
I20260807 10:44:14.238456 25419 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:44:14.242575 25445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:14.244488 25419 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:44:14.244712 25419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "a817823b578c4315a020f975a3830b44"
format_stamp: "Formatted at 2026-08-07 10:44:14 on dist-test-slave-42z9"
server_key: "0c423aaea99282e5b2367dca06de1596"
server_key_iv: "8cb3bbbe92e2d14650d63a014cc2c0ad"
server_key_version: "encryptionkey@0"
I20260807 10:44:14.244975 25419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:14.278280 25419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:14.279315 25419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:14.279665 25419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:14.299505 25419 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:37461
I20260807 10:44:14.299527 25515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:37461 every 8 connection(s)
I20260807 10:44:14.301054 25419 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:44:14.305593 25516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:44:14.311092 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 25419
I20260807 10:44:14.311348 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:44:14.312211 11450 external_mini_cluster.cc:1428] Setting key 2668108483b8a8cf981c57e02cf43fbc
I20260807 10:44:14.320839 25516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44: Bootstrap starting.
I20260807 10:44:14.325228 25516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44: Neither blocks nor log segments found. Creating new log.
I20260807 10:44:14.326808 25516 log.cc:824] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44: Log is configured to *not* fsync() on all Append() calls
I20260807 10:44:14.330420 25520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:14.314960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45200 (local address 127.11.46.190:37461)
0807 10:44:14.316367 (+ 1407us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:14.316384 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:14.316556 (+ 172us) server_negotiation.cc:407] Connection header received
0807 10:44:14.319228 (+ 2672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:14.319314 (+ 86us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:14.320118 (+ 804us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:14.320692 (+ 574us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:14.321342 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:14.323415 (+ 2073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:14.324814 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:14.325991 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:14.326191 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:14.327486 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:14.327502 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:14.327541 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:14.328181 (+ 640us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:14.328268 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:14.328292 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:14.328407 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:14.328645 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 10:44:14.329013 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":794,"thread_start_us":471,"threads_started":1}
I20260807 10:44:14.330790 25516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44: No bootstrap required, opened a new log
I20260807 10:44:14.338863 25516 raft_consensus.cc:348] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a817823b578c4315a020f975a3830b44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37461 } }
I20260807 10:44:14.339478 25516 raft_consensus.cc:374] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:44:14.339607 25516 raft_consensus.cc:729] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a817823b578c4315a020f975a3830b44, State: Initialized, Role: FOLLOWER
I20260807 10:44:14.340360 25516 consensus_queue.cc:260] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a817823b578c4315a020f975a3830b44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37461 } }
I20260807 10:44:14.340651 25516 raft_consensus.cc:388] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:44:14.340803 25516 raft_consensus.cc:482] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:44:14.340977 25516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:44:14.343535 25516 raft_consensus.cc:504] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a817823b578c4315a020f975a3830b44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37461 } }
I20260807 10:44:14.344170 25516 leader_election.cc:302] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a817823b578c4315a020f975a3830b44; no voters:
I20260807 10:44:14.344857 25516 leader_election.cc:288] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:44:14.345031 25524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:44:14.346351 25524 raft_consensus.cc:686] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [term 1 LEADER]: Becoming Leader. State: Replica: a817823b578c4315a020f975a3830b44, State: Running, Role: LEADER
I20260807 10:44:14.347092 25524 consensus_queue.cc:237] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a817823b578c4315a020f975a3830b44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37461 } }
I20260807 10:44:14.347664 25516 sys_catalog.cc:564] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:44:14.350476 25530 sys_catalog.cc:455] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a817823b578c4315a020f975a3830b44. Latest consensus state: current_term: 1 leader_uuid: "a817823b578c4315a020f975a3830b44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a817823b578c4315a020f975a3830b44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37461 } } }
I20260807 10:44:14.351073 25530 sys_catalog.cc:458] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [sys.catalog]: This master's current role is: LEADER
I20260807 10:44:14.350967 25528 sys_catalog.cc:455] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a817823b578c4315a020f975a3830b44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a817823b578c4315a020f975a3830b44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 37461 } } }
I20260807 10:44:14.351302 25528 sys_catalog.cc:458] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44 [sys.catalog]: This master's current role is: LEADER
I20260807 10:44:14.352742 25536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:44:14.361409 25536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:44:14.372484 25536 catalog_manager.cc:1347] Generated new cluster ID: cf220a692d7c4fc88b3e8ae1da57d4fc
I20260807 10:44:14.372622 25536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:44:14.387367 25536 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:44:14.388895 25536 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:44:14.399994 25536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a817823b578c4315a020f975a3830b44: Generated new TSK 0
I20260807 10:44:14.401060 25536 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:44:14.410068 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:37461
--builtin_ntp_servers=127.11.46.148:39715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 10:44:14.801035 25554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:14.801393 25554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:14.801560 25554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:14.809900 25554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:14.810060 25554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:14.810227 25554 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:44:14.820580 25554 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:37461
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:14.822157 25554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:14.824317 25554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:14.839741 25560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:14.839773 25563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:14.839800 25561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:14.840987 25554 server_base.cc:1034] running on GCE node
I20260807 10:44:14.841786 25554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:14.842950 25554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:14.844208 25554 hybrid_clock.cc:648] HybridClock initialized: now 1786099454844132 us; error 55 us; skew 500 ppm
I20260807 10:44:14.844632 25554 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:44:14.853737 25554 webserver.cc:460] Webserver started at http://127.11.46.129:35851/ using document root <none> and password file <none>
I20260807 10:44:14.854667 25554 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:14.854792 25554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:14.855187 25554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:14.858779 25554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "0840c860a7ee491b90a738dbddd1efbe"
format_stamp: "Formatted at 2026-08-07 10:44:14 on dist-test-slave-42z9"
server_key: "28dad85b48b2201c1c607cb467ec287e"
server_key_iv: "e995105e698088caaddc4b4ca29053eb"
server_key_version: "encryptionkey@0"
I20260807 10:44:14.859807 25554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "0840c860a7ee491b90a738dbddd1efbe"
format_stamp: "Formatted at 2026-08-07 10:44:14 on dist-test-slave-42z9"
server_key: "28dad85b48b2201c1c607cb467ec287e"
server_key_iv: "e995105e698088caaddc4b4ca29053eb"
server_key_version: "encryptionkey@0"
I20260807 10:44:14.866616 25554 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 10:44:14.871192 25572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:14.872948 25554 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:44:14.873188 25554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "0840c860a7ee491b90a738dbddd1efbe"
format_stamp: "Formatted at 2026-08-07 10:44:14 on dist-test-slave-42z9"
server_key: "28dad85b48b2201c1c607cb467ec287e"
server_key_iv: "e995105e698088caaddc4b4ca29053eb"
server_key_version: "encryptionkey@0"
I20260807 10:44:14.873500 25554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:14.914640 25554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:14.915761 25554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:14.916113 25554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:14.917328 25554 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:44:14.919245 25554 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:44:14.919389 25554 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:14.919534 25554 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:44:14.919615 25554 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:14.954420 25554 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:36857
I20260807 10:44:14.954455 25727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:36857 every 8 connection(s)
I20260807 10:44:14.955889 25554 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:44:14.957255 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 25554
I20260807 10:44:14.957513 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:44:14.958381 11450 external_mini_cluster.cc:1428] Setting key 02f0f27162980a36364a569e4dc60254
I20260807 10:44:14.961545 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:37461
--builtin_ntp_servers=127.11.46.148:39715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 10:44:14.971122 25733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:14.959301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:51985 (local address 127.11.46.190:37461)
0807 10:44:14.959909 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:14.959915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:14.961879 (+ 1964us) server_negotiation.cc:407] Connection header received
0807 10:44:14.963937 (+ 2058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:14.963943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:14.964045 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:14.964144 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:14.965488 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:14.966246 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:14.967919 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:14.968345 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:14.968467 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:14.970176 (+ 1709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:14.970183 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:14.970186 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:14.970208 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:14.970254 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:14.970266 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:14.970342 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:14.970612 (+ 270us) server_negotiation.cc:299] Negotiation successful
0807 10:44:14.970736 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":272,"threads_started":1}
I20260807 10:44:14.972296 25734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:14.960021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:37461 (local address 127.11.46.129:51985)
0807 10:44:14.961435 (+ 1414us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:14.961603 (+ 168us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:14.963574 (+ 1971us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:14.964467 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:14.964477 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:14.964585 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:14.965263 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:14.965283 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:14.966416 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:14.966420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:14.967738 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:14.967754 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:14.968613 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:14.968622 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:14.968917 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:14.969793 (+ 876us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:44:14.969797 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:14.969844 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:44:14.969942 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:44:14.970361 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:44:14.970374 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:44:14.970383 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 10:44:14.970581 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 10:44:14.971058 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":378,"threads_started":1}
I20260807 10:44:14.974103 25728 heartbeater.cc:347] Connected to a master server at 127.11.46.190:37461
I20260807 10:44:14.974494 25728 heartbeater.cc:464] Registering TS with master...
I20260807 10:44:14.975595 25728 heartbeater.cc:511] Master 127.11.46.190:37461 requested a full tablet report, sending...
I20260807 10:44:14.978312 25469 ts_manager.cc:194] Registered new tserver with Master: 0840c860a7ee491b90a738dbddd1efbe (127.11.46.129:36857)
I20260807 10:44:14.980146 25469 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.129:51985
W20260807 10:44:15.359113 25736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:15.359503 25736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:15.359647 25736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:15.367676 25736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:15.367833 25736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:15.367977 25736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:44:15.378243 25736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:37461
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:15.379868 25736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:15.381983 25736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:15.397133 25745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:15.397171 25743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:15.397208 25742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:15.398025 25736 server_base.cc:1034] running on GCE node
I20260807 10:44:15.398810 25736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:15.400003 25736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:15.403481 25736 hybrid_clock.cc:648] HybridClock initialized: now 1786099455403322 us; error 73 us; skew 500 ppm
I20260807 10:44:15.404167 25736 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:44:15.407696 25736 webserver.cc:460] Webserver started at http://127.11.46.130:40277/ using document root <none> and password file <none>
I20260807 10:44:15.408694 25736 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:15.408846 25736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:15.409246 25736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:15.412889 25736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "d4a07465a0cc4283be053e7f216fd7f2"
format_stamp: "Formatted at 2026-08-07 10:44:15 on dist-test-slave-42z9"
server_key: "5fadf05c139b65f813cc2025740c0442"
server_key_iv: "edd3aa1b7dac2cea084a0da51ca7d1c8"
server_key_version: "encryptionkey@0"
I20260807 10:44:15.414021 25736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "d4a07465a0cc4283be053e7f216fd7f2"
format_stamp: "Formatted at 2026-08-07 10:44:15 on dist-test-slave-42z9"
server_key: "5fadf05c139b65f813cc2025740c0442"
server_key_iv: "edd3aa1b7dac2cea084a0da51ca7d1c8"
server_key_version: "encryptionkey@0"
I20260807 10:44:15.420869 25736 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260807 10:44:15.425376 25755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:15.427366 25736 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:44:15.427595 25736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "d4a07465a0cc4283be053e7f216fd7f2"
format_stamp: "Formatted at 2026-08-07 10:44:15 on dist-test-slave-42z9"
server_key: "5fadf05c139b65f813cc2025740c0442"
server_key_iv: "edd3aa1b7dac2cea084a0da51ca7d1c8"
server_key_version: "encryptionkey@0"
I20260807 10:44:15.427865 25736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:15.450603 25736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:15.451676 25736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:15.452018 25736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:15.453223 25736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:44:15.455298 25736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:44:15.455426 25736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:15.455564 25736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:44:15.455643 25736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:15.492363 25736 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:44013
I20260807 10:44:15.492435 25918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:44013 every 8 connection(s)
I20260807 10:44:15.493911 25736 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:44:15.501892 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 25736
I20260807 10:44:15.502100 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:44:15.502679 11450 external_mini_cluster.cc:1428] Setting key 7587da7639b14fd239e60a0f5e262e68
I20260807 10:44:15.506654 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:37461
--builtin_ntp_servers=127.11.46.148:39715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 10:44:15.509204 25922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:15.496828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:37991 (local address 127.11.46.190:37461)
0807 10:44:15.497301 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:15.497307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:15.498703 (+ 1396us) server_negotiation.cc:407] Connection header received
0807 10:44:15.500660 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:15.500666 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:15.500773 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:15.500916 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:15.502306 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:15.503400 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:15.505855 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:15.506514 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:15.506682 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:15.508286 (+ 1604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:15.508294 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:15.508298 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:15.508324 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:15.508387 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:15.508404 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:15.508509 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:15.508720 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 10:44:15.508837 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":243,"threads_started":1}
I20260807 10:44:15.510322 25923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:15.497404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:37461 (local address 127.11.46.130:37991)
0807 10:44:15.498488 (+ 1084us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:15.498539 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:15.500326 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:15.501165 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:15.501175 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:15.501278 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:15.502051 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:15.502081 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:15.503636 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:15.503642 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:15.505646 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:15.505664 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:15.506766 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:15.506772 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:15.507085 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:15.507846 (+ 761us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:44:15.507849 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:15.507902 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:44:15.508013 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:44:15.508509 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:44:15.508515 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:44:15.508521 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 10:44:15.508672 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 10:44:15.509053 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":312,"threads_started":1}
I20260807 10:44:15.511947 25920 heartbeater.cc:347] Connected to a master server at 127.11.46.190:37461
I20260807 10:44:15.512368 25920 heartbeater.cc:464] Registering TS with master...
I20260807 10:44:15.513509 25920 heartbeater.cc:511] Master 127.11.46.190:37461 requested a full tablet report, sending...
I20260807 10:44:15.515370 25469 ts_manager.cc:194] Registered new tserver with Master: d4a07465a0cc4283be053e7f216fd7f2 (127.11.46.130:44013)
I20260807 10:44:15.516249 25469 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.130:37991
W20260807 10:44:15.897177 25924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:15.897557 25924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:15.897697 25924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:15.905503 25924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:15.905643 25924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:15.905794 25924 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:44:15.915606 25924 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:37461
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:15.917256 25924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:15.919507 25924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:15.934976 25932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:15.935014 25934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:15.935057 25936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:15.935837 25924 server_base.cc:1034] running on GCE node
I20260807 10:44:15.936590 25924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:15.937775 25924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:15.939013 25924 hybrid_clock.cc:648] HybridClock initialized: now 1786099455938947 us; error 60 us; skew 500 ppm
I20260807 10:44:15.939429 25924 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:44:15.942067 25924 webserver.cc:460] Webserver started at http://127.11.46.131:38463/ using document root <none> and password file <none>
I20260807 10:44:15.942920 25924 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:15.943041 25924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:15.943403 25924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:15.946789 25924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "e9131470d7254b11b2c755eb8bc5d279"
format_stamp: "Formatted at 2026-08-07 10:44:15 on dist-test-slave-42z9"
server_key: "c0a903b4624c734861db4e583b639bb7"
server_key_iv: "316329e320eddbb8cdd8bcb9cd27e979"
server_key_version: "encryptionkey@0"
I20260807 10:44:15.947737 25924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "e9131470d7254b11b2c755eb8bc5d279"
format_stamp: "Formatted at 2026-08-07 10:44:15 on dist-test-slave-42z9"
server_key: "c0a903b4624c734861db4e583b639bb7"
server_key_iv: "316329e320eddbb8cdd8bcb9cd27e979"
server_key_version: "encryptionkey@0"
I20260807 10:44:15.954303 25924 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260807 10:44:15.958702 25947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:15.960417 25924 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260807 10:44:15.960629 25924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "e9131470d7254b11b2c755eb8bc5d279"
format_stamp: "Formatted at 2026-08-07 10:44:15 on dist-test-slave-42z9"
server_key: "c0a903b4624c734861db4e583b639bb7"
server_key_iv: "316329e320eddbb8cdd8bcb9cd27e979"
server_key_version: "encryptionkey@0"
I20260807 10:44:15.960878 25924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:15.977828 25924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:15.978853 25924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:15.979182 25924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:15.980314 25924 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:44:15.982059 25924 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:44:15.982163 25924 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:15.982286 25924 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:44:15.982358 25924 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:15.984740 25728 heartbeater.cc:503] Master 127.11.46.190:37461 was elected leader, sending a full tablet report...
I20260807 10:44:16.016746 25924 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:46559
I20260807 10:44:16.016847 26108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:46559 every 8 connection(s)
I20260807 10:44:16.018343 25924 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:44:16.023893 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 25924
I20260807 10:44:16.024123 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:44:16.024662 11450 external_mini_cluster.cc:1428] Setting key ea83299e486659624bf164721149b19d
I20260807 10:44:16.032979 26111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:16.021246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:51147 (local address 127.11.46.190:37461)
0807 10:44:16.021747 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:16.021752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:16.023074 (+ 1322us) server_negotiation.cc:407] Connection header received
0807 10:44:16.025579 (+ 2505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:16.025584 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:16.025673 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:16.025771 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:16.027223 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:16.028263 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:16.030044 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:16.030498 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:16.030606 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:16.032119 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:16.032125 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:16.032128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:16.032151 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:16.032200 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:16.032212 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:16.032282 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:16.032543 (+ 261us) server_negotiation.cc:299] Negotiation successful
0807 10:44:16.032647 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":256,"threads_started":1}
I20260807 10:44:16.034160 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:16.021926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:37461 (local address 127.11.46.131:51147)
0807 10:44:16.022896 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:16.022938 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:16.025250 (+ 2312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:16.026014 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:16.026036 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:16.026169 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:16.027046 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:16.027070 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:16.028426 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:16.028430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:16.029883 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:16.029899 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:16.030707 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:16.030712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:16.030946 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:16.031739 (+ 793us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:44:16.031742 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:16.031815 (+ 73us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:44:16.031919 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:44:16.032306 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:44:16.032317 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:44:16.032325 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 10:44:16.032494 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 10:44:16.032872 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":326,"threads_started":1}
I20260807 10:44:16.035826 26109 heartbeater.cc:347] Connected to a master server at 127.11.46.190:37461
I20260807 10:44:16.036204 26109 heartbeater.cc:464] Registering TS with master...
I20260807 10:44:16.037146 26109 heartbeater.cc:511] Master 127.11.46.190:37461 requested a full tablet report, sending...
I20260807 10:44:16.038990 25469 ts_manager.cc:194] Registered new tserver with Master: e9131470d7254b11b2c755eb8bc5d279 (127.11.46.131:46559)
I20260807 10:44:16.039999 25469 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.131:51147
I20260807 10:44:16.040848 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 10:44:16.047135 26111 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:16.045640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45202 (local address 127.11.46.190:37461)
0807 10:44:16.045818 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:16.045822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:16.046238 (+ 416us) server_negotiation.cc:407] Connection header received
0807 10:44:16.046399 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:16.046404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:16.046474 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:16.046573 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:16.046928 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45202: BlockingRecv error: recv got EOF from 127.0.0.1:45202 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:44:16.047802 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 25554
I20260807 10:44:16.056686 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:16.049009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33618 (local address 127.11.46.129:36857)
0807 10:44:16.049670 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:16.049679 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:16.049715 (+ 36us) server_negotiation.cc:407] Connection header received
0807 10:44:16.049788 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:16.049795 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:16.050034 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:16.050188 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:16.050647 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:16.051693 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:16.053143 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:16.053855 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:16.053994 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:16.055153 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:16.055164 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:16.055180 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:16.055795 (+ 615us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:16.055849 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:16.055873 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:16.055993 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:16.056158 (+ 165us) server_negotiation.cc:299] Negotiation successful
0807 10:44:16.056309 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":266,"threads_started":1}
I20260807 10:44:16.058130 25723 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:16.144423 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 25554
I20260807 10:44:16.173359 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 25736
I20260807 10:44:16.182523 26130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:16.174474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47242 (local address 127.11.46.130:44013)
0807 10:44:16.175084 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:16.175091 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:16.175124 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:44:16.175193 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:16.175201 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:16.175463 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:16.175618 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:16.176331 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:16.177416 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:16.179095 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:16.179752 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:16.179887 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:16.180930 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:16.180939 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:16.180956 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:16.181687 (+ 731us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:16.181747 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:16.181775 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:16.181874 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:16.182032 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 10:44:16.182180 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":302,"threads_started":1}
I20260807 10:44:16.184002 25913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:16.269727 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 25736
I20260807 10:44:16.299979 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 25924
I20260807 10:44:16.308665 26132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:16.300997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42838 (local address 127.11.46.131:46559)
0807 10:44:16.301673 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:16.301681 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:16.301712 (+ 31us) server_negotiation.cc:407] Connection header received
0807 10:44:16.301775 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:16.301783 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:16.302011 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:16.302162 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:16.302656 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:16.303760 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:16.305044 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:16.305811 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:16.305952 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:16.307116 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:16.307126 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:16.307142 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:16.307787 (+ 645us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:16.307841 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:16.307863 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:16.307985 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:16.308143 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 10:44:16.308292 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":296,"threads_started":1}
I20260807 10:44:16.310123 26102 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:16.395000 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 25924
I20260807 10:44:16.421351 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 25419
I20260807 10:44:16.422678 25506 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:16.531656 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 25419
2026-08-07T10:44:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2832 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T10:44:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:44:16Z Disabled control of system clock
I20260807 10:44:16.638525 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:45263
--webserver_interface=127.11.46.190
--webserver_port=0
--builtin_ntp_servers=127.11.46.148:35949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:45263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 10:44:17.010886 26143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:17.011220 26143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:17.011322 26143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:17.018865 26143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:44:17.019006 26143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:17.019052 26143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:17.019114 26143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:44:17.019160 26143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:44:17.028967 26143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:45263
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:45263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:17.030412 26143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:17.032444 26143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:17.044592 26156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:17.044679 26150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:17.044620 26149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:17.045851 26143 server_base.cc:1034] running on GCE node
I20260807 10:44:17.046753 26143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:17.048352 26143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:17.049559 26143 hybrid_clock.cc:648] HybridClock initialized: now 1786099457049498 us; error 51 us; skew 500 ppm
I20260807 10:44:17.049970 26143 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:44:17.052372 26143 webserver.cc:460] Webserver started at http://127.11.46.190:42275/ using document root <none> and password file <none>
I20260807 10:44:17.053113 26143 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:17.053218 26143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:17.053591 26143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:17.056663 26143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "e20342c57ffc4c35aec40451ac74976d"
format_stamp: "Formatted at 2026-08-07 10:44:17 on dist-test-slave-42z9"
server_key: "d75009e13022fb1b6e9d50671db2786b"
server_key_iv: "1297e7cd066555eda0eb98b7e6679cde"
server_key_version: "encryptionkey@0"
I20260807 10:44:17.057607 26143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "e20342c57ffc4c35aec40451ac74976d"
format_stamp: "Formatted at 2026-08-07 10:44:17 on dist-test-slave-42z9"
server_key: "d75009e13022fb1b6e9d50671db2786b"
server_key_iv: "1297e7cd066555eda0eb98b7e6679cde"
server_key_version: "encryptionkey@0"
I20260807 10:44:17.063678 26143 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:44:17.068580 26162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:17.070549 26143 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 10:44:17.070784 26143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "e20342c57ffc4c35aec40451ac74976d"
format_stamp: "Formatted at 2026-08-07 10:44:17 on dist-test-slave-42z9"
server_key: "d75009e13022fb1b6e9d50671db2786b"
server_key_iv: "1297e7cd066555eda0eb98b7e6679cde"
server_key_version: "encryptionkey@0"
I20260807 10:44:17.071041 26143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:17.078425 26143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:17.079418 26143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:17.079741 26143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:17.099311 26143 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:45263
I20260807 10:44:17.099332 26239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:45263 every 8 connection(s)
I20260807 10:44:17.100883 26143 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:44:17.102900 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 26143
I20260807 10:44:17.103132 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:44:17.103997 11450 external_mini_cluster.cc:1428] Setting key fd7a23cb1a08d13144b77a4d37985241
I20260807 10:44:17.106369 26240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:44:17.113710 26243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:17.106380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47752 (local address 127.11.46.190:45263)
0807 10:44:17.107528 (+ 1148us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:17.107540 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:17.107590 (+ 50us) server_negotiation.cc:407] Connection header received
0807 10:44:17.109340 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:17.109369 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:17.110050 (+ 681us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:17.110474 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:17.111753 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:17.111761 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:17.111777 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:17.111797 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:17.111887 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:17.111913 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:17.112110 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:17.112234 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 10:44:17.112579 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":420,"threads_started":1}
I20260807 10:44:17.119760 26240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d: Bootstrap starting.
I20260807 10:44:17.123232 26240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d: Neither blocks nor log segments found. Creating new log.
I20260807 10:44:17.124380 26240 log.cc:824] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d: Log is configured to *not* fsync() on all Append() calls
I20260807 10:44:17.128412 26240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d: No bootstrap required, opened a new log
I20260807 10:44:17.136893 26240 raft_consensus.cc:348] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20342c57ffc4c35aec40451ac74976d" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45263 } }
I20260807 10:44:17.137339 26240 raft_consensus.cc:374] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:44:17.137600 26240 raft_consensus.cc:729] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e20342c57ffc4c35aec40451ac74976d, State: Initialized, Role: FOLLOWER
I20260807 10:44:17.138288 26240 consensus_queue.cc:260] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20342c57ffc4c35aec40451ac74976d" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45263 } }
I20260807 10:44:17.138568 26240 raft_consensus.cc:388] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:44:17.138710 26240 raft_consensus.cc:482] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:44:17.138883 26240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:44:17.141279 26240 raft_consensus.cc:504] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20342c57ffc4c35aec40451ac74976d" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45263 } }
I20260807 10:44:17.141970 26240 leader_election.cc:302] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e20342c57ffc4c35aec40451ac74976d; no voters:
I20260807 10:44:17.142688 26240 leader_election.cc:288] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:44:17.142829 26245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:44:17.143568 26245 raft_consensus.cc:686] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [term 1 LEADER]: Becoming Leader. State: Replica: e20342c57ffc4c35aec40451ac74976d, State: Running, Role: LEADER
I20260807 10:44:17.144249 26245 consensus_queue.cc:237] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20342c57ffc4c35aec40451ac74976d" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45263 } }
I20260807 10:44:17.145296 26240 sys_catalog.cc:564] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:44:17.147840 26247 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e20342c57ffc4c35aec40451ac74976d. Latest consensus state: current_term: 1 leader_uuid: "e20342c57ffc4c35aec40451ac74976d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20342c57ffc4c35aec40451ac74976d" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45263 } } }
I20260807 10:44:17.147670 26246 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e20342c57ffc4c35aec40451ac74976d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e20342c57ffc4c35aec40451ac74976d" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45263 } } }
I20260807 10:44:17.148257 26247 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [sys.catalog]: This master's current role is: LEADER
I20260807 10:44:17.148547 26246 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d [sys.catalog]: This master's current role is: LEADER
I20260807 10:44:17.155102 26257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:44:17.162093 26257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:44:17.172691 26257 catalog_manager.cc:1347] Generated new cluster ID: c1ab1d7b96174df2a329f8bdd98ed6f5
I20260807 10:44:17.172844 26257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:44:17.213594 26257 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:44:17.214234 26257 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:44:17.225744 26257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e20342c57ffc4c35aec40451ac74976d: Generated new TSK 0
I20260807 10:44:17.226989 26257 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:44:17.243747 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45263
--builtin_ntp_servers=127.11.46.148:35949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 10:44:17.624094 26270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:17.624433 26270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:17.624575 26270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:17.632390 26270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:17.632519 26270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:17.632674 26270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:44:17.642412 26270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:17.643931 26270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:17.646062 26270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:17.661504 26283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:17.661545 26276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:17.661700 26277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:17.662514 26270 server_base.cc:1034] running on GCE node
I20260807 10:44:17.663334 26270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:17.664418 26270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:17.665609 26270 hybrid_clock.cc:648] HybridClock initialized: now 1786099457665546 us; error 61 us; skew 500 ppm
I20260807 10:44:17.665970 26270 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:44:17.668533 26270 webserver.cc:460] Webserver started at http://127.11.46.129:39285/ using document root <none> and password file <none>
I20260807 10:44:17.669358 26270 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:17.669515 26270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:17.669895 26270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:17.673038 26270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "d389726bac414ee2b9ce0c9ec1f3729b"
format_stamp: "Formatted at 2026-08-07 10:44:17 on dist-test-slave-42z9"
server_key: "6f09a2d59b35728a5d486a74bdac3a59"
server_key_iv: "842aeba241c6ce62a169d7a0c886133b"
server_key_version: "encryptionkey@0"
I20260807 10:44:17.673965 26270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "d389726bac414ee2b9ce0c9ec1f3729b"
format_stamp: "Formatted at 2026-08-07 10:44:17 on dist-test-slave-42z9"
server_key: "6f09a2d59b35728a5d486a74bdac3a59"
server_key_iv: "842aeba241c6ce62a169d7a0c886133b"
server_key_version: "encryptionkey@0"
I20260807 10:44:17.680348 26270 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:44:17.684566 26293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:17.686249 26270 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:44:17.686450 26270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "d389726bac414ee2b9ce0c9ec1f3729b"
format_stamp: "Formatted at 2026-08-07 10:44:17 on dist-test-slave-42z9"
server_key: "6f09a2d59b35728a5d486a74bdac3a59"
server_key_iv: "842aeba241c6ce62a169d7a0c886133b"
server_key_version: "encryptionkey@0"
I20260807 10:44:17.686710 26270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:17.693607 26270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:17.694646 26270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:17.694957 26270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:17.696101 26270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:44:17.697901 26270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:44:17.698017 26270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:17.698144 26270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:44:17.698235 26270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:17.732759 26270 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:33301
I20260807 10:44:17.732808 26458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:33301 every 8 connection(s)
I20260807 10:44:17.734292 26270 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:44:17.738850 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 26270
I20260807 10:44:17.739084 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:44:17.739799 11450 external_mini_cluster.cc:1428] Setting key 452388ffb11f58a07762405e97861073
I20260807 10:44:17.742748 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45263
--builtin_ntp_servers=127.11.46.148:35949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 10:44:17.743953 26461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:17.737211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:41245 (local address 127.11.46.190:45263)
0807 10:44:17.737757 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:17.737764 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:17.739269 (+ 1505us) server_negotiation.cc:407] Connection header received
0807 10:44:17.741325 (+ 2056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:17.741331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:17.741403 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:17.741553 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:17.743105 (+ 1552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:17.743111 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:17.743115 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:17.743136 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:17.743199 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:17.743212 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:17.743333 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:17.743550 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 10:44:17.743633 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":259,"threads_started":1}
I20260807 10:44:17.745119 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:17.737917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:45263 (local address 127.11.46.129:41245)
0807 10:44:17.739060 (+ 1143us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:17.739114 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:17.741024 (+ 1910us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:17.741825 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:17.741836 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:17.741952 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:17.742700 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:44:17.742703 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:17.742760 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:44:17.742883 (+ 123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:44:17.743306 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:44:17.743320 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:44:17.743328 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 10:44:17.743632 (+ 304us) client_negotiation.cc:240] Negotiation successful
0807 10:44:17.743975 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":346,"threads_started":1}
I20260807 10:44:17.746976 26459 heartbeater.cc:347] Connected to a master server at 127.11.46.190:45263
I20260807 10:44:17.747350 26459 heartbeater.cc:464] Registering TS with master...
I20260807 10:44:17.748117 26459 heartbeater.cc:511] Master 127.11.46.190:45263 requested a full tablet report, sending...
I20260807 10:44:17.750833 26184 ts_manager.cc:194] Registered new tserver with Master: d389726bac414ee2b9ce0c9ec1f3729b (127.11.46.129:33301)
W20260807 10:44:18.135666 26464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:18.135994 26464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:18.136090 26464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:18.143859 26464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:18.144006 26464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:18.144124 26464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:44:18.154287 26464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:18.155776 26464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:18.157832 26464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:18.172878 26472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:18.172830 26471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:18.172922 26474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:18.174221 26464 server_base.cc:1034] running on GCE node
I20260807 10:44:18.174932 26464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:18.176110 26464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:18.177340 26464 hybrid_clock.cc:648] HybridClock initialized: now 1786099458177287 us; error 65 us; skew 500 ppm
I20260807 10:44:18.177760 26464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:44:18.180356 26464 webserver.cc:460] Webserver started at http://127.11.46.130:40069/ using document root <none> and password file <none>
I20260807 10:44:18.181198 26464 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:18.181319 26464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:18.181743 26464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:18.185166 26464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "6f1403c57cb8438e8cf3d26134d50062"
format_stamp: "Formatted at 2026-08-07 10:44:18 on dist-test-slave-42z9"
server_key: "cfb2228fc79bbc80a44ed96d0c8c3847"
server_key_iv: "8a3c39f4dce03971b7cd02e9a4c8a61e"
server_key_version: "encryptionkey@0"
I20260807 10:44:18.186170 26464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "6f1403c57cb8438e8cf3d26134d50062"
format_stamp: "Formatted at 2026-08-07 10:44:18 on dist-test-slave-42z9"
server_key: "cfb2228fc79bbc80a44ed96d0c8c3847"
server_key_iv: "8a3c39f4dce03971b7cd02e9a4c8a61e"
server_key_version: "encryptionkey@0"
I20260807 10:44:18.192684 26464 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:44:18.196951 26484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:18.199105 26464 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 10:44:18.199373 26464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "6f1403c57cb8438e8cf3d26134d50062"
format_stamp: "Formatted at 2026-08-07 10:44:18 on dist-test-slave-42z9"
server_key: "cfb2228fc79bbc80a44ed96d0c8c3847"
server_key_iv: "8a3c39f4dce03971b7cd02e9a4c8a61e"
server_key_version: "encryptionkey@0"
I20260807 10:44:18.199640 26464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:18.206449 26464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:18.207475 26464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:18.207777 26464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:18.208856 26464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:44:18.210517 26464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:44:18.210624 26464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:18.210745 26464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:44:18.210815 26464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:18.244517 26464 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:34727
I20260807 10:44:18.244611 26653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:34727 every 8 connection(s)
I20260807 10:44:18.246079 26464 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:44:18.249286 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 26464
I20260807 10:44:18.249492 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:44:18.250054 11450 external_mini_cluster.cc:1428] Setting key e59808a5edb196aa8e64f34726a6126d
I20260807 10:44:18.253043 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45263
--builtin_ntp_servers=127.11.46.148:35949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 10:44:18.255086 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:18.248789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:40277 (local address 127.11.46.190:45263)
0807 10:44:18.249361 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:18.249367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:18.250851 (+ 1484us) server_negotiation.cc:407] Connection header received
0807 10:44:18.252733 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:18.252739 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:18.252806 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:18.252940 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:18.254326 (+ 1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:18.254332 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:18.254337 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:18.254361 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:18.254421 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:18.254438 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:18.254565 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:18.254702 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 10:44:18.254771 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":318,"threads_started":1}
I20260807 10:44:18.255995 26658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:18.249490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:45263 (local address 127.11.46.130:40277)
0807 10:44:18.250672 (+ 1182us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:18.250732 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:18.252450 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:18.253136 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:18.253145 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:18.253272 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:18.253998 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:44:18.254001 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:18.254050 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:44:18.254146 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:44:18.254529 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:44:18.254535 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:44:18.254540 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 10:44:18.254759 (+ 219us) client_negotiation.cc:240] Negotiation successful
0807 10:44:18.254980 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":350,"threads_started":1}
I20260807 10:44:18.257404 26654 heartbeater.cc:347] Connected to a master server at 127.11.46.190:45263
I20260807 10:44:18.257773 26654 heartbeater.cc:464] Registering TS with master...
I20260807 10:44:18.258515 26654 heartbeater.cc:511] Master 127.11.46.190:45263 requested a full tablet report, sending...
I20260807 10:44:18.260126 26184 ts_manager.cc:194] Registered new tserver with Master: 6f1403c57cb8438e8cf3d26134d50062 (127.11.46.130:34727)
W20260807 10:44:18.632522 26659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:18.632867 26659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:18.633008 26659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:18.640556 26659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:18.640695 26659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:18.640839 26659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:44:18.650393 26659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:18.651760 26659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:18.653646 26659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:18.668166 26668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:18.668140 26671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:18.668097 26669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:18.669420 26659 server_base.cc:1034] running on GCE node
I20260807 10:44:18.670183 26659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:18.671336 26659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:18.672607 26659 hybrid_clock.cc:648] HybridClock initialized: now 1786099458672537 us; error 55 us; skew 500 ppm
I20260807 10:44:18.673024 26659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:44:18.676509 26659 webserver.cc:460] Webserver started at http://127.11.46.131:42717/ using document root <none> and password file <none>
I20260807 10:44:18.677489 26659 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:18.677614 26659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:18.677948 26659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:18.681298 26659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "d4d8006ed60541888003afd849d52fa2"
format_stamp: "Formatted at 2026-08-07 10:44:18 on dist-test-slave-42z9"
server_key: "0ced2fc2e864350b2531154b7e561ae7"
server_key_iv: "d37bb54353c318bdc33b7d750c55b787"
server_key_version: "encryptionkey@0"
I20260807 10:44:18.682391 26659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "d4d8006ed60541888003afd849d52fa2"
format_stamp: "Formatted at 2026-08-07 10:44:18 on dist-test-slave-42z9"
server_key: "0ced2fc2e864350b2531154b7e561ae7"
server_key_iv: "d37bb54353c318bdc33b7d750c55b787"
server_key_version: "encryptionkey@0"
I20260807 10:44:18.688639 26659 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:44:18.693413 26678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:18.695115 26659 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:44:18.695297 26659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "d4d8006ed60541888003afd849d52fa2"
format_stamp: "Formatted at 2026-08-07 10:44:18 on dist-test-slave-42z9"
server_key: "0ced2fc2e864350b2531154b7e561ae7"
server_key_iv: "d37bb54353c318bdc33b7d750c55b787"
server_key_version: "encryptionkey@0"
I20260807 10:44:18.695544 26659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:18.701896 26659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:18.702827 26659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:18.703085 26659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:18.704183 26659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:44:18.705945 26659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:44:18.706049 26659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:18.706143 26659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:44:18.706197 26659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:18.742038 26659 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:45205
I20260807 10:44:18.742089 26839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:45205 every 8 connection(s)
I20260807 10:44:18.743438 26659 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:44:18.748508 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 26659
I20260807 10:44:18.748678 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:44:18.749116 11450 external_mini_cluster.cc:1428] Setting key 26c705e8c24e1f210f1b3f61547c30cd
I20260807 10:44:18.752857 26657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:18.746202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:38773 (local address 127.11.46.190:45263)
0807 10:44:18.746377 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:18.746382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:18.748093 (+ 1711us) server_negotiation.cc:407] Connection header received
0807 10:44:18.750165 (+ 2072us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:18.750170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:18.750250 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:18.750344 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:18.752133 (+ 1789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:18.752138 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:18.752141 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:18.752160 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:18.752199 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:18.752212 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:18.752312 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:18.752563 (+ 251us) server_negotiation.cc:299] Negotiation successful
0807 10:44:18.752635 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 10:44:18.754081 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:18.746773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:45263 (local address 127.11.46.131:38773)
0807 10:44:18.747882 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:18.747942 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:18.749810 (+ 1868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:18.750674 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:18.750688 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:18.750838 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:18.751707 (+ 869us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:44:18.751710 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:18.751771 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:44:18.751922 (+ 151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:44:18.752323 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:44:18.752335 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:44:18.752345 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 10:44:18.752620 (+ 275us) client_negotiation.cc:240] Negotiation successful
0807 10:44:18.752943 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":324,"threads_started":1}
I20260807 10:44:18.754442 26459 heartbeater.cc:503] Master 127.11.46.190:45263 was elected leader, sending a full tablet report...
I20260807 10:44:18.755604 26842 heartbeater.cc:347] Connected to a master server at 127.11.46.190:45263
I20260807 10:44:18.755954 26842 heartbeater.cc:464] Registering TS with master...
I20260807 10:44:18.756599 26842 heartbeater.cc:511] Master 127.11.46.190:45263 requested a full tablet report, sending...
I20260807 10:44:18.758172 26184 ts_manager.cc:194] Registered new tserver with Master: d4d8006ed60541888003afd849d52fa2 (127.11.46.131:45205)
I20260807 10:44:18.766393 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 10:44:18.773433 26657 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:44:18.771444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47762 (local address 127.11.46.190:45263)
0807 10:44:18.771712 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:18.771719 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:18.772054 (+ 335us) server_negotiation.cc:407] Connection header received
0807 10:44:18.772334 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:18.772341 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:18.772432 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:18.772567 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:18.773034 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47762: BlockingRecv error: recv got EOF from 127.0.0.1:47762 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 10:44:18.773958 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 26270
I20260807 10:44:18.779007 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:18.775646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44950 (local address 127.11.46.129:33301)
0807 10:44:18.776401 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:18.776412 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:18.776448 (+ 36us) server_negotiation.cc:407] Connection header received
0807 10:44:18.776531 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:18.776540 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:18.776838 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:18.777022 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:18.778201 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:18.778208 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:18.778222 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:18.778237 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:18.778281 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:18.778296 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:18.778474 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:18.778551 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 10:44:18.778673 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":283,"threads_started":1}
I20260807 10:44:18.780437 26453 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:18.866175 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 26270
I20260807 10:44:18.895568 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 26464
I20260807 10:44:18.899461 26858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:18.896637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48154 (local address 127.11.46.130:34727)
0807 10:44:18.897246 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:18.897253 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:18.897284 (+ 31us) server_negotiation.cc:407] Connection header received
0807 10:44:18.897364 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:18.897371 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:18.897654 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:18.897791 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:18.898731 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:18.898738 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:18.898751 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:18.898769 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:18.898810 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:18.898823 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:18.898934 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:18.898988 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 10:44:18.899093 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":273,"threads_started":1}
I20260807 10:44:18.900808 26647 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:18.985041 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 26464
I20260807 10:44:19.012665 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 26659
I20260807 10:44:19.016713 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:19.013690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33860 (local address 127.11.46.131:45205)
0807 10:44:19.014282 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:19.014289 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:19.014322 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:44:19.014388 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:19.014395 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:19.014619 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:19.014773 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:19.015919 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:19.015926 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:19.015939 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:44:19.015953 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:19.015999 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:44:19.016012 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:19.016186 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:19.016263 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 10:44:19.016424 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":265,"threads_started":1}
I20260807 10:44:19.018118 26834 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:19.104158 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 26659
I20260807 10:44:19.130409 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 26143
I20260807 10:44:19.131814 26233 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:19.245635 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 26143
2026-08-07T10:44:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2720 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:44:19 dist-test-slave-42z9 krb5kdc[26866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:44:19 dist-test-slave-42z9 krb5kdc[26866](info): set up 2 sockets
Aug 07 10:44:19 dist-test-slave-42z9 krb5kdc[26866](info): commencing operation
krb5kdc: starting...
W20260807 10:44:20.521214 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.004s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:44:20 dist-test-slave-42z9 krb5kdc[26866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:44:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:44:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:44:20.874751 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:40269
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:42513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:40269
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:44:21.263917 26883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:21.264277 26883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:21.264389 26883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:21.272248 26883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:44:21.272411 26883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:21.272476 26883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:21.272537 26883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:44:21.272583 26883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:44:21.283429 26883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:42513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:40269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:40269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:21.284991 26883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:21.286557 26883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:21.300834 26890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:21.301002 26891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:21.301725 26897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:21.301893 26883 server_base.cc:1034] running on GCE node
I20260807 10:44:21.302906 26883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:21.304664 26883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:21.305902 26883 hybrid_clock.cc:648] HybridClock initialized: now 1786099461305825 us; error 72 us; skew 500 ppm
I20260807 10:44:21.306329 26883 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:44:21 dist-test-slave-42z9 krb5kdc[26866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099461, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:44:21.313964 26883 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:44:21.315908 26883 webserver.cc:460] Webserver started at http://127.11.46.190:43035/ using document root <none> and password file <none>
I20260807 10:44:21.316787 26883 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:21.316923 26883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:21.317284 26883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:21.321002 26883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "cf766668bc2641d989358858178e7462"
format_stamp: "Formatted at 2026-08-07 10:44:21 on dist-test-slave-42z9"
server_key: "9ab9c93c5fd3a194cb9725a042601b73"
server_key_iv: "0b23bdee3ac3327ffbdde04df408339e"
server_key_version: "encryptionkey@0"
I20260807 10:44:21.322000 26883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "cf766668bc2641d989358858178e7462"
format_stamp: "Formatted at 2026-08-07 10:44:21 on dist-test-slave-42z9"
server_key: "9ab9c93c5fd3a194cb9725a042601b73"
server_key_iv: "0b23bdee3ac3327ffbdde04df408339e"
server_key_version: "encryptionkey@0"
I20260807 10:44:21.328373 26883 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:44:21.332600 26914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:21.334439 26883 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:44:21.334697 26883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "cf766668bc2641d989358858178e7462"
format_stamp: "Formatted at 2026-08-07 10:44:21 on dist-test-slave-42z9"
server_key: "9ab9c93c5fd3a194cb9725a042601b73"
server_key_iv: "0b23bdee3ac3327ffbdde04df408339e"
server_key_version: "encryptionkey@0"
I20260807 10:44:21.334944 26883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:21.371797 26883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:21.376487 26883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:21.376835 26883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:21.397374 26883 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:40269
I20260807 10:44:21.397410 26993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:40269 every 8 connection(s)
I20260807 10:44:21.398975 26883 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:44:21.402820 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 26883
I20260807 10:44:21.403065 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:44:21.403422 26994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:44:21.403973 11450 external_mini_cluster.cc:1428] Setting key b093e31675f98bbee1bd0f8a684a3159
Aug 07 10:44:21 dist-test-slave-42z9 krb5kdc[26866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:44:21.419643 26994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462: Bootstrap starting.
I20260807 10:44:21.423877 26994 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462: Neither blocks nor log segments found. Creating new log.
I20260807 10:44:21.425395 26994 log.cc:824] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462: Log is configured to *not* fsync() on all Append() calls
I20260807 10:44:21.429389 26994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462: No bootstrap required, opened a new log
I20260807 10:44:21.429761 26997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:21.406240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37302 (local address 127.11.46.190:40269)
0807 10:44:21.407098 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:21.407111 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:21.407157 (+ 46us) server_negotiation.cc:407] Connection header received
0807 10:44:21.408789 (+ 1632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:21.408815 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:21.409238 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:21.409647 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:21.411567 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:21.412891 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:21.414665 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:21.415391 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:21.415530 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:21.420911 (+ 5381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:21.420922 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:21.420942 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:21.420996 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:21.424324 (+ 3328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:21.425366 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:21.425377 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:21.425384 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:21.425690 (+ 306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:21.426211 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:21.426217 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:21.426220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:21.427142 (+ 922us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:21.427409 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:21.428018 (+ 609us) server_negotiation.cc:299] Negotiation successful
0807 10:44:21.428519 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":380,"threads_started":1}
I20260807 10:44:21.438261 26994 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf766668bc2641d989358858178e7462" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40269 } }
I20260807 10:44:21.438803 26994 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:44:21.438920 26994 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf766668bc2641d989358858178e7462, State: Initialized, Role: FOLLOWER
I20260807 10:44:21.439728 26994 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf766668bc2641d989358858178e7462" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40269 } }
I20260807 10:44:21.440058 26994 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:44:21.440225 26994 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:44:21.440402 26994 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:44:21.442947 26994 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf766668bc2641d989358858178e7462" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40269 } }
I20260807 10:44:21.443614 26994 leader_election.cc:302] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf766668bc2641d989358858178e7462; no voters:
I20260807 10:44:21.444417 26994 leader_election.cc:288] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:44:21.444553 26999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:44:21.445313 26999 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [term 1 LEADER]: Becoming Leader. State: Replica: cf766668bc2641d989358858178e7462, State: Running, Role: LEADER
I20260807 10:44:21.446036 26999 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf766668bc2641d989358858178e7462" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40269 } }
I20260807 10:44:21.446931 26994 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:44:21.448890 27000 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf766668bc2641d989358858178e7462" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf766668bc2641d989358858178e7462" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40269 } } }
I20260807 10:44:21.449060 27001 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf766668bc2641d989358858178e7462. Latest consensus state: current_term: 1 leader_uuid: "cf766668bc2641d989358858178e7462" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf766668bc2641d989358858178e7462" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40269 } } }
I20260807 10:44:21.449366 27000 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [sys.catalog]: This master's current role is: LEADER
I20260807 10:44:21.449366 27001 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462 [sys.catalog]: This master's current role is: LEADER
I20260807 10:44:21.450390 27008 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:44:21.457517 27008 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:44:21.468346 27008 catalog_manager.cc:1347] Generated new cluster ID: 01a5abd6133b4e1897bb220c87c88e08
I20260807 10:44:21.468498 27008 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:44:21.496091 27008 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:44:21.497704 27008 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:44:21.507304 27008 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462: Generated new TSK 0
I20260807 10:44:21.508306 27008 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:44:21.597407 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40269
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:42513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:44:21.985797 27027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:21.986147 27027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:21.986268 27027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:21.994273 27027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:21.994442 27027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:21.994625 27027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:44:22.005767 27027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:42513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:22.007611 27027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:22.009179 27027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:22.024052 27037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:22.024040 27036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:22.024005 27039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:22.025566 27027 server_base.cc:1034] running on GCE node
I20260807 10:44:22.026260 27027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:22.027359 27027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:22.028595 27027 hybrid_clock.cc:648] HybridClock initialized: now 1786099462028530 us; error 39 us; skew 500 ppm
I20260807 10:44:22.028946 27027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:44:22 dist-test-slave-42z9 krb5kdc[26866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099462, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:44:22.032408 27027 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:44:22.034260 27027 webserver.cc:460] Webserver started at http://127.11.46.129:46731/ using document root <none> and password file <none>
I20260807 10:44:22.035076 27027 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:22.035198 27027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:22.035524 27027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:22.039119 27027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "e48de536e58d43d98c99e5645d47d236"
format_stamp: "Formatted at 2026-08-07 10:44:22 on dist-test-slave-42z9"
server_key: "454f8c2f49f6ab06249478fd00bf227c"
server_key_iv: "dd477a7ad63fa261eaa9e41c59ed082e"
server_key_version: "encryptionkey@0"
I20260807 10:44:22.040153 27027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "e48de536e58d43d98c99e5645d47d236"
format_stamp: "Formatted at 2026-08-07 10:44:22 on dist-test-slave-42z9"
server_key: "454f8c2f49f6ab06249478fd00bf227c"
server_key_iv: "dd477a7ad63fa261eaa9e41c59ed082e"
server_key_version: "encryptionkey@0"
I20260807 10:44:22.047015 27027 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:44:22.051599 27046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:22.053301 27027 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260807 10:44:22.053536 27027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "e48de536e58d43d98c99e5645d47d236"
format_stamp: "Formatted at 2026-08-07 10:44:22 on dist-test-slave-42z9"
server_key: "454f8c2f49f6ab06249478fd00bf227c"
server_key_iv: "dd477a7ad63fa261eaa9e41c59ed082e"
server_key_version: "encryptionkey@0"
I20260807 10:44:22.053784 27027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:22.075664 27027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:22.080502 27027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:22.080839 27027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:22.082007 27027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:44:22.083670 27027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:44:22.083757 27027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:22.083899 27027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:44:22.083954 27027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:22.119524 27027 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:33557
I20260807 10:44:22.119585 27210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:33557 every 8 connection(s)
I20260807 10:44:22.120956 27027 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:44:22.124184 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 27027
I20260807 10:44:22.124414 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:44:22.125279 11450 external_mini_cluster.cc:1428] Setting key 6f65a60563dc812c0ebe52d72a950856
Aug 07 10:44:22 dist-test-slave-42z9 krb5kdc[26866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099462, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:44:22.145597 27213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:22.123685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:58703 (local address 127.11.46.190:40269)
0807 10:44:22.124156 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:22.124160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:22.125358 (+ 1198us) server_negotiation.cc:407] Connection header received
0807 10:44:22.127535 (+ 2177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:22.127541 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:22.127631 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:22.127751 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:22.129626 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:22.130662 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:22.133243 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:22.133859 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:22.134012 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:22.138681 (+ 4669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:22.138688 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:22.138691 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:22.138733 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:22.141517 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:22.142661 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:22.142666 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:22.142668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:22.142811 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:22.143419 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:22.143426 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:22.143429 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:22.143835 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:22.144005 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:22.144924 (+ 919us) server_negotiation.cc:299] Negotiation successful
0807 10:44:22.145196 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":230,"threads_started":1}
I20260807 10:44:22.146610 27214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:22.124334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40269 (local address 127.11.46.129:58703)
0807 10:44:22.125175 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:22.125217 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:22.127176 (+ 1959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:22.128012 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:22.128021 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:22.128626 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:22.129303 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:22.129325 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:22.131040 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:22.131049 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:22.132973 (+ 1924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:22.133001 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:22.134244 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:22.134252 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:22.134593 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:22.135390 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:22.135427 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:22.138320 (+ 2893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:44:22.141761 (+ 3441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:44:22.141774 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:44:22.141798 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:44:22.142529 (+ 731us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:44:22.142932 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:44:22.142937 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:44:22.142940 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:44:22.143228 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:44:22.144022 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:44:22.144030 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:44:22.144482 (+ 452us) client_negotiation.cc:769] Sending connection context
0807 10:44:22.144758 (+ 276us) client_negotiation.cc:240] Negotiation successful
0807 10:44:22.145264 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":333,"threads_started":1}
I20260807 10:44:22.148485 27211 heartbeater.cc:347] Connected to a master server at 127.11.46.190:40269
I20260807 10:44:22.148845 27211 heartbeater.cc:464] Registering TS with master...
I20260807 10:44:22.149780 27211 heartbeater.cc:511] Master 127.11.46.190:40269 requested a full tablet report, sending...
I20260807 10:44:22.152400 26944 ts_manager.cc:194] Registered new tserver with Master: e48de536e58d43d98c99e5645d47d236 (127.11.46.129:33557)
I20260807 10:44:22.154059 26944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:58703
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:44:22.202382 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40269
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:42513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:44:22.597041 27218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:22.597406 27218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:22.597620 27218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:22.605742 27218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:22.605911 27218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:22.606084 27218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:44:22.616729 27218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:42513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:22.618345 27218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:22.619926 27218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:22.634495 27229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:22.634521 27234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:22.634588 27231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:22.635767 27218 server_base.cc:1034] running on GCE node
I20260807 10:44:22.636463 27218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:22.637609 27218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:22.638831 27218 hybrid_clock.cc:648] HybridClock initialized: now 1786099462638772 us; error 50 us; skew 500 ppm
I20260807 10:44:22.639215 27218 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:44:22 dist-test-slave-42z9 krb5kdc[26866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099462, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:44:22.642685 27218 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:44:22.644498 27218 webserver.cc:460] Webserver started at http://127.11.46.130:46255/ using document root <none> and password file <none>
I20260807 10:44:22.645380 27218 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:22.645573 27218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:22.645910 27218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:22.649595 27218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "efd2f2b26b1244089bee32b23d245663"
format_stamp: "Formatted at 2026-08-07 10:44:22 on dist-test-slave-42z9"
server_key: "b0cc1f96812762d371f91f3b3bd8ed21"
server_key_iv: "4875c60eb2cc026d2af875c0b8ffc5e8"
server_key_version: "encryptionkey@0"
I20260807 10:44:22.650475 27218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "efd2f2b26b1244089bee32b23d245663"
format_stamp: "Formatted at 2026-08-07 10:44:22 on dist-test-slave-42z9"
server_key: "b0cc1f96812762d371f91f3b3bd8ed21"
server_key_iv: "4875c60eb2cc026d2af875c0b8ffc5e8"
server_key_version: "encryptionkey@0"
I20260807 10:44:22.656800 27218 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260807 10:44:22.661054 27242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:22.662680 27218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:44:22.662849 27218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "efd2f2b26b1244089bee32b23d245663"
format_stamp: "Formatted at 2026-08-07 10:44:22 on dist-test-slave-42z9"
server_key: "b0cc1f96812762d371f91f3b3bd8ed21"
server_key_iv: "4875c60eb2cc026d2af875c0b8ffc5e8"
server_key_version: "encryptionkey@0"
I20260807 10:44:22.663065 27218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:22.699702 27218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:22.704536 27218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:22.704839 27218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:22.706039 27218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:44:22.707653 27218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:44:22.707742 27218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:22.707855 27218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:44:22.707901 27218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:22.742655 27218 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:36797
I20260807 10:44:22.742700 27394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:36797 every 8 connection(s)
I20260807 10:44:22.744120 27218 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:44:22.749974 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 27218
I20260807 10:44:22.750171 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:44:22.750731 11450 external_mini_cluster.cc:1428] Setting key 9ae635bcab0d48f95bd3351111f2c70b
Aug 07 10:44:22 dist-test-slave-42z9 krb5kdc[26866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099462, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:44:22.768553 27400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:22.747166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:47203 (local address 127.11.46.190:40269)
0807 10:44:22.747732 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:22.747737 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:22.748607 (+ 870us) server_negotiation.cc:407] Connection header received
0807 10:44:22.751084 (+ 2477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:22.751089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:22.751169 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:22.751264 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:22.753292 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:22.754081 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:22.756523 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:22.756995 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:22.757103 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:22.761847 (+ 4744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:22.761853 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:22.761857 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:22.761900 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:22.764622 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:22.765647 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:22.765653 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:22.765655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:22.765805 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:22.766323 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:22.766328 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:22.766330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:22.766666 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:22.766848 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:22.767812 (+ 964us) server_negotiation.cc:299] Negotiation successful
0807 10:44:22.768104 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":319,"threads_started":1}
I20260807 10:44:22.769908 27403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:22.747664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40269 (local address 127.11.46.130:47203)
0807 10:44:22.748426 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:22.748480 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:22.750707 (+ 2227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:22.751544 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:22.751552 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:22.752256 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:22.753073 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:22.753104 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:22.754269 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:22.754274 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:22.756321 (+ 2047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:22.756343 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:22.757277 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:22.757284 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:22.757641 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:22.758565 (+ 924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:22.758606 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:22.761518 (+ 2912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:44:22.764849 (+ 3331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:44:22.764860 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:44:22.764881 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:44:22.765501 (+ 620us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:44:22.765937 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:44:22.765943 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:44:22.765946 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:44:22.766194 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:44:22.766875 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:44:22.766885 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:44:22.767380 (+ 495us) client_negotiation.cc:769] Sending connection context
0807 10:44:22.767668 (+ 288us) client_negotiation.cc:240] Negotiation successful
0807 10:44:22.768371 (+ 703us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":294,"threads_started":1}
I20260807 10:44:22.771711 27395 heartbeater.cc:347] Connected to a master server at 127.11.46.190:40269
I20260807 10:44:22.772083 27395 heartbeater.cc:464] Registering TS with master...
I20260807 10:44:22.772944 27395 heartbeater.cc:511] Master 127.11.46.190:40269 requested a full tablet report, sending...
I20260807 10:44:22.774927 26944 ts_manager.cc:194] Registered new tserver with Master: efd2f2b26b1244089bee32b23d245663 (127.11.46.130:36797)
I20260807 10:44:22.776206 26944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:47203
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:44:22.829829 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40269
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:42513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:44:23.160099 27211 heartbeater.cc:503] Master 127.11.46.190:40269 was elected leader, sending a full tablet report...
W20260807 10:44:23.216646 27409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:44:23.217131 27409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:44:23.217303 27409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:44:23.225697 27409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:44:23.225838 27409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:44:23.225975 27409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:44:23.236660 27409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:42513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:44:23.238229 27409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:44:23.239820 27409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:44:23.256451 27420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:23.256429 27416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:44:23.256515 27414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:44:23.257398 27409 server_base.cc:1034] running on GCE node
I20260807 10:44:23.258281 27409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:44:23.259564 27409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:44:23.260823 27409 hybrid_clock.cc:648] HybridClock initialized: now 1786099463260753 us; error 52 us; skew 500 ppm
I20260807 10:44:23.261238 27409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:44:23 dist-test-slave-42z9 krb5kdc[26866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:44:23.265391 27409 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:44:23.267290 27409 webserver.cc:460] Webserver started at http://127.11.46.131:36509/ using document root <none> and password file <none>
I20260807 10:44:23.268215 27409 fs_manager.cc:359] Metadata directory not provided
I20260807 10:44:23.268359 27409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:44:23.268714 27409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:44:23.272270 27409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b"
format_stamp: "Formatted at 2026-08-07 10:44:23 on dist-test-slave-42z9"
server_key: "cd5cd6b998235495ddba71da2e83ae01"
server_key_iv: "d869c91c40543988e96dcbd7238bfa90"
server_key_version: "encryptionkey@0"
I20260807 10:44:23.273219 27409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b"
format_stamp: "Formatted at 2026-08-07 10:44:23 on dist-test-slave-42z9"
server_key: "cd5cd6b998235495ddba71da2e83ae01"
server_key_iv: "d869c91c40543988e96dcbd7238bfa90"
server_key_version: "encryptionkey@0"
I20260807 10:44:23.280273 27409 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260807 10:44:23.284709 27429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:23.286427 27409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:44:23.286654 27409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b"
format_stamp: "Formatted at 2026-08-07 10:44:23 on dist-test-slave-42z9"
server_key: "cd5cd6b998235495ddba71da2e83ae01"
server_key_iv: "d869c91c40543988e96dcbd7238bfa90"
server_key_version: "encryptionkey@0"
I20260807 10:44:23.286902 27409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:44:23.310413 27409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:44:23.315253 27409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:44:23.315587 27409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:44:23.316677 27409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:44:23.318259 27409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:44:23.318351 27409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:23.318486 27409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:44:23.318549 27409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:44:23.352555 27409 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:44083
I20260807 10:44:23.352592 27591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:44083 every 8 connection(s)
I20260807 10:44:23.354184 27409 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:44:23.355283 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 27409
I20260807 10:44:23.355484 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:44:23.356066 11450 external_mini_cluster.cc:1428] Setting key e776fc93b2097ebff7905bf004a9842b
Aug 07 10:44:23 dist-test-slave-42z9 krb5kdc[26866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099463, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:44:23.378495 27595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.357487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:60131 (local address 127.11.46.190:40269)
0807 10:44:23.358050 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:23.358056 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:23.359498 (+ 1442us) server_negotiation.cc:407] Connection header received
0807 10:44:23.361686 (+ 2188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:23.361691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:23.361777 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:23.361894 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:23.363692 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.364563 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.366461 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.366968 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.367082 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.371074 (+ 3992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:23.371080 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:23.371085 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:23.371133 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:23.374868 (+ 3735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:23.375956 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:23.375961 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:23.375963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:23.376128 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:23.376638 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:23.376642 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:23.376644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:23.376950 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:23.377098 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:23.377941 (+ 843us) server_negotiation.cc:299] Negotiation successful
0807 10:44:23.378165 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":350,"threads_started":1}
I20260807 10:44:23.379611 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.358219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40269 (local address 127.11.46.131:60131)
0807 10:44:23.359291 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:23.359367 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:23.361290 (+ 1923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:23.362119 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:23.362128 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:23.362777 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:44:23.363474 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.363501 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.364771 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.364776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.366280 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.366299 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.367203 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.367209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.367453 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.368219 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:44:23.368246 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:44:23.370783 (+ 2537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:44:23.375087 (+ 4304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:44:23.375098 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:44:23.375117 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:44:23.375779 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:44:23.376273 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:44:23.376278 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:44:23.376280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:44:23.376532 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:44:23.377060 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:44:23.377067 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:44:23.377554 (+ 487us) client_negotiation.cc:769] Sending connection context
0807 10:44:23.377833 (+ 279us) client_negotiation.cc:240] Negotiation successful
0807 10:44:23.378331 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"thread_start_us":423,"threads_started":1}
I20260807 10:44:23.381337 27593 heartbeater.cc:347] Connected to a master server at 127.11.46.190:40269
I20260807 10:44:23.381747 27593 heartbeater.cc:464] Registering TS with master...
I20260807 10:44:23.382648 27593 heartbeater.cc:511] Master 127.11.46.190:40269 requested a full tablet report, sending...
I20260807 10:44:23.384696 26943 ts_manager.cc:194] Registered new tserver with Master: dcf25f45dcb84d2eab8ab4c983c7af1b (127.11.46.131:44083)
I20260807 10:44:23.385939 26943 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:60131
I20260807 10:44:23.386214 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:44:23.407481 27595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.392462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37318 (local address 127.11.46.190:40269)
0807 10:44:23.392704 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:23.392712 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:23.393197 (+ 485us) server_negotiation.cc:407] Connection header received
0807 10:44:23.393330 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:23.393334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:23.393415 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:23.393571 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:23.395111 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.395906 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.397279 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.397986 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.398135 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.400645 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:23.400652 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:23.400657 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:23.400707 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:23.404499 (+ 3792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:23.405427 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:23.405434 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:23.405464 (+ 30us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:23.405648 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:23.406060 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:23.406064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:23.406066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:23.406438 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:23.406637 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:23.406954 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 10:44:23.407176 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:44:23.412282 26943 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37318:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:44:23.419970 26943 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:44:23.460170 27612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.436241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:36797 (local address 127.0.0.1:34204)
0807 10:44:23.437321 (+ 1080us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:23.437366 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:23.437610 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:23.451617 (+ 14007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:23.451625 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:23.451689 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:44:23.452735 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.452752 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.454810 (+ 2058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.454819 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.457054 (+ 2235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.457066 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.459141 (+ 2075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.459148 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.459415 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.459491 (+ 76us) client_negotiation.cc:769] Sending connection context
0807 10:44:23.459617 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 10:44:23.459794 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":794,"mutex_wait_us":362,"spinlock_wait_cycles":6016,"thread_start_us":627,"threads_started":1}
I20260807 10:44:23.460294 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.437951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:44083 (local address 127.0.0.1:50832)
0807 10:44:23.448061 (+ 10110us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:23.448079 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:23.448192 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:23.451619 (+ 3427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:23.451626 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:23.451702 (+ 76us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:44:23.452245 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.452260 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.454295 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.454301 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.456953 (+ 2652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.456977 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.459353 (+ 2376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.459363 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.459557 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.459594 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:44:23.459665 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 10:44:23.459809 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9954,"mutex_wait_us":82,"spinlock_wait_cycles":26112,"thread_start_us":10015,"threads_started":1}
I20260807 10:44:23.461226 27614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.436569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34204 (local address 127.11.46.130:36797)
0807 10:44:23.450807 (+ 14238us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:23.450816 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:23.450849 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:44:23.450970 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:23.450979 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:23.451292 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:23.452081 (+ 789us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:44:23.452937 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.454659 (+ 1722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.457237 (+ 2578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.458835 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.460481 (+ 1646us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.460747 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:23.460822 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 10:44:23.460974 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14062,"thread_start_us":13996,"threads_started":1}
I20260807 10:44:23.461402 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.438375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50832 (local address 127.11.46.131:44083)
0807 10:44:23.450821 (+ 12446us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:23.450831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:23.450883 (+ 52us) server_negotiation.cc:407] Connection header received
0807 10:44:23.451006 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:23.451014 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:23.451283 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:23.451581 (+ 298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:44:23.452528 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.454123 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.457174 (+ 3051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.458887 (+ 1713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.460529 (+ 1642us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.460791 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:23.460869 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 10:44:23.461057 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12217,"thread_start_us":12844,"threads_started":1}
I20260807 10:44:23.462247 27615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.436656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33557 (local address 127.0.0.1:47092)
0807 10:44:23.447611 (+ 10955us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:23.447641 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:23.447850 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:23.452058 (+ 4208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:23.452063 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:23.452093 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:44:23.452689 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.452705 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.456909 (+ 4204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.456914 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.459044 (+ 2130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.459063 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.461406 (+ 2343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.461412 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.461614 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.461649 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 10:44:23.461742 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 10:44:23.461893 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10727,"mutex_wait_us":41,"thread_start_us":10512,"threads_started":1}
I20260807 10:44:23.462482 27616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.437285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47092 (local address 127.11.46.129:33557)
0807 10:44:23.451448 (+ 14163us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:23.451457 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:23.451486 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:44:23.451591 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:23.451599 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:23.451834 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:23.452064 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:44:23.452899 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.454659 (+ 1760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.459286 (+ 4627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.461164 (+ 1878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.461319 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.461597 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:23.461877 (+ 280us) server_negotiation.cc:299] Negotiation successful
0807 10:44:23.462078 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13942,"thread_start_us":13724,"threads_started":1}
I20260807 10:44:23.465729 27302 tablet_service.cc:1467] Processing CreateTablet for tablet e718ec5bc36b434092104c6be7f8e5fb (DEFAULT_TABLE table=test-table [id=038838ddb9fb44d5bf395f69fe444b27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:44:23.465737 27495 tablet_service.cc:1467] Processing CreateTablet for tablet e718ec5bc36b434092104c6be7f8e5fb (DEFAULT_TABLE table=test-table [id=038838ddb9fb44d5bf395f69fe444b27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:44:23.466027 27123 tablet_service.cc:1467] Processing CreateTablet for tablet e718ec5bc36b434092104c6be7f8e5fb (DEFAULT_TABLE table=test-table [id=038838ddb9fb44d5bf395f69fe444b27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:44:23.467233 27302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e718ec5bc36b434092104c6be7f8e5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:44:23.467298 27123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e718ec5bc36b434092104c6be7f8e5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:44:23.467315 27495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e718ec5bc36b434092104c6be7f8e5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:44:23.480706 27619 tablet_bootstrap.cc:492] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: Bootstrap starting.
I20260807 10:44:23.484417 27619 tablet_bootstrap.cc:654] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: Neither blocks nor log segments found. Creating new log.
I20260807 10:44:23.485950 27619 log.cc:824] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: Log is configured to *not* fsync() on all Append() calls
I20260807 10:44:23.486243 27620 tablet_bootstrap.cc:492] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: Bootstrap starting.
I20260807 10:44:23.486845 27622 tablet_bootstrap.cc:492] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: Bootstrap starting.
I20260807 10:44:23.490437 27622 tablet_bootstrap.cc:654] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: Neither blocks nor log segments found. Creating new log.
I20260807 10:44:23.490433 27620 tablet_bootstrap.cc:654] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: Neither blocks nor log segments found. Creating new log.
I20260807 10:44:23.491474 27619 tablet_bootstrap.cc:492] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: No bootstrap required, opened a new log
I20260807 10:44:23.491854 27619 ts_tablet_manager.cc:1397] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.003s
I20260807 10:44:23.491832 27622 log.cc:824] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: Log is configured to *not* fsync() on all Append() calls
I20260807 10:44:23.491860 27620 log.cc:824] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: Log is configured to *not* fsync() on all Append() calls
I20260807 10:44:23.495419 27620 tablet_bootstrap.cc:492] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: No bootstrap required, opened a new log
I20260807 10:44:23.495536 27622 tablet_bootstrap.cc:492] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: No bootstrap required, opened a new log
I20260807 10:44:23.495775 27620 ts_tablet_manager.cc:1397] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260807 10:44:23.495867 27622 ts_tablet_manager.cc:1397] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260807 10:44:23.503715 27619 raft_consensus.cc:348] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 } } peers { permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 } } peers { permanent_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44083 } }
I20260807 10:44:23.504339 27619 raft_consensus.cc:374] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:44:23.504510 27619 raft_consensus.cc:729] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd2f2b26b1244089bee32b23d245663, State: Initialized, Role: FOLLOWER
I20260807 10:44:23.504777 27620 raft_consensus.cc:348] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 } } peers { permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 } } peers { permanent_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44083 } }
I20260807 10:44:23.505240 27620 raft_consensus.cc:374] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:44:23.505348 27620 raft_consensus.cc:729] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcf25f45dcb84d2eab8ab4c983c7af1b, State: Initialized, Role: FOLLOWER
I20260807 10:44:23.505317 27619 consensus_queue.cc:260] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 } } peers { permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 } } peers { permanent_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44083 } }
I20260807 10:44:23.505977 27620 consensus_queue.cc:260] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 } } peers { permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 } } peers { permanent_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44083 } }
I20260807 10:44:23.507160 27622 raft_consensus.cc:348] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 } } peers { permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 } } peers { permanent_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44083 } }
I20260807 10:44:23.507730 27622 raft_consensus.cc:374] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:44:23.507841 27622 raft_consensus.cc:729] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e48de536e58d43d98c99e5645d47d236, State: Initialized, Role: FOLLOWER
I20260807 10:44:23.508672 27622 consensus_queue.cc:260] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 } } peers { permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 } } peers { permanent_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44083 } }
I20260807 10:44:23.511440 27619 ts_tablet_manager.cc:1428] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: Time spent starting tablet: real 0.019s user 0.014s sys 0.003s
I20260807 10:44:23.511668 27620 ts_tablet_manager.cc:1428] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260807 10:44:23.512253 27593 heartbeater.cc:503] Master 127.11.46.190:40269 was elected leader, sending a full tablet report...
I20260807 10:44:23.512319 27395 heartbeater.cc:503] Master 127.11.46.190:40269 was elected leader, sending a full tablet report...
I20260807 10:44:23.513684 27622 ts_tablet_manager.cc:1428] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: Time spent starting tablet: real 0.018s user 0.018s sys 0.000s
I20260807 10:44:23.573604 27631 raft_consensus.cc:482] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:44:23.574018 27631 raft_consensus.cc:504] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 } } peers { permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 } } peers { permanent_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44083 } }
I20260807 10:44:23.576174 27631 leader_election.cc:288] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd2f2b26b1244089bee32b23d245663 (127.11.46.130:36797), e48de536e58d43d98c99e5645d47d236 (127.11.46.129:33557)
I20260807 10:44:23.582854 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.576677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:36797 (local address 127.11.46.131:34685)
0807 10:44:23.576889 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:23.576911 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:23.577055 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:23.577429 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:23.577435 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:23.577508 (+ 73us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:44:23.577730 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.577742 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.578962 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.578967 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.580787 (+ 1820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.580807 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.582209 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.582214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.582380 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.582408 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 10:44:23.582491 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 10:44:23.582606 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":30}
I20260807 10:44:23.582976 27614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.576741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:34685 (local address 127.11.46.130:36797)
0807 10:44:23.576951 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:23.576957 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:23.576982 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:44:23.577202 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:23.577206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:23.577270 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:23.577368 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:44:23.577893 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.578816 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.580984 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.582033 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.582212 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.582299 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:23.582549 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 10:44:23.582702 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:44:23.583974 27616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.576775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:41085 (local address 127.11.46.129:33557)
0807 10:44:23.576976 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:23.576981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:23.577996 (+ 1015us) server_negotiation.cc:407] Connection header received
0807 10:44:23.578121 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:23.578127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:23.578207 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:23.578299 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:44:23.578796 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.579580 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.581723 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.582919 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.583102 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.583181 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:23.583645 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 10:44:23.583767 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:44:23.584154 27633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.576703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33557 (local address 127.11.46.131:41085)
0807 10:44:23.577885 (+ 1182us) negotiation.cc:107] Waiting for socket to connect
0807 10:44:23.577905 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:44:23.578011 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:44:23.578312 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:44:23.578315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:44:23.578332 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:44:23.578634 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.578643 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.579758 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.579764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.581551 (+ 1787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:44:23.581566 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.583333 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.583338 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:44:23.583473 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.583498 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 10:44:23.583589 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:44:23.583738 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1065,"mutex_wait_us":195,"thread_start_us":439,"threads_started":1}
I20260807 10:44:23.584236 27330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e718ec5bc36b434092104c6be7f8e5fb" candidate_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd2f2b26b1244089bee32b23d245663" is_pre_election: true
I20260807 10:44:23.584911 27330 raft_consensus.cc:2454] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf25f45dcb84d2eab8ab4c983c7af1b in term 0.
I20260807 10:44:23.585793 27436 leader_election.cc:302] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcf25f45dcb84d2eab8ab4c983c7af1b, efd2f2b26b1244089bee32b23d245663; no voters:
I20260807 10:44:23.585749 27151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e718ec5bc36b434092104c6be7f8e5fb" candidate_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48de536e58d43d98c99e5645d47d236" is_pre_election: true
I20260807 10:44:23.586241 27631 raft_consensus.cc:2781] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:44:23.586356 27151 raft_consensus.cc:2454] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcf25f45dcb84d2eab8ab4c983c7af1b in term 0.
I20260807 10:44:23.586457 27631 raft_consensus.cc:482] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:44:23.586565 27631 raft_consensus.cc:3037] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:44:23.589257 27631 raft_consensus.cc:504] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 } } peers { permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 } } peers { permanent_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44083 } }
I20260807 10:44:23.590055 27631 leader_election.cc:288] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [CANDIDATE]: Term 1 election: Requested vote from peers efd2f2b26b1244089bee32b23d245663 (127.11.46.130:36797), e48de536e58d43d98c99e5645d47d236 (127.11.46.129:33557)
I20260807 10:44:23.590718 27330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e718ec5bc36b434092104c6be7f8e5fb" candidate_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd2f2b26b1244089bee32b23d245663"
I20260807 10:44:23.590718 27151 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e718ec5bc36b434092104c6be7f8e5fb" candidate_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e48de536e58d43d98c99e5645d47d236"
I20260807 10:44:23.590976 27330 raft_consensus.cc:3037] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:44:23.590977 27151 raft_consensus.cc:3037] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:44:23.594558 27330 raft_consensus.cc:2454] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf25f45dcb84d2eab8ab4c983c7af1b in term 1.
I20260807 10:44:23.594558 27151 raft_consensus.cc:2454] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcf25f45dcb84d2eab8ab4c983c7af1b in term 1.
I20260807 10:44:23.595155 27436 leader_election.cc:302] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcf25f45dcb84d2eab8ab4c983c7af1b, efd2f2b26b1244089bee32b23d245663; no voters:
I20260807 10:44:23.595579 27631 raft_consensus.cc:2781] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:44:23.596109 27631 raft_consensus.cc:686] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 1 LEADER]: Becoming Leader. State: Replica: dcf25f45dcb84d2eab8ab4c983c7af1b, State: Running, Role: LEADER
I20260807 10:44:23.596752 27631 consensus_queue.cc:237] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 } } peers { permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 } } peers { permanent_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44083 } }
I20260807 10:44:23.602113 26944 catalog_manager.cc:5495] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b reported cstate change: term changed from 0 to 1, leader changed from <none> to dcf25f45dcb84d2eab8ab4c983c7af1b (127.11.46.131). New cstate: current_term: 1 leader_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcf25f45dcb84d2eab8ab4c983c7af1b" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44083 } health_report { overall_health: HEALTHY } } }
W20260807 10:44:23.606029 27594 tablet.cc:2369] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:44:23.623975 27212 tablet.cc:2369] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:44:23.656533 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.650665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50844 (local address 127.11.46.131:44083)
0807 10:44:23.650888 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:23.650894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:23.651067 (+ 173us) server_negotiation.cc:407] Connection header received
0807 10:44:23.651308 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:23.651313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:23.651402 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:23.651558 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:44:23.651986 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.652724 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.654151 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.654575 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.654692 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.655255 (+ 563us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:44:23.655853 (+ 598us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:44:23.656001 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:23.656142 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 10:44:23.656246 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:44:23.666805 27151 raft_consensus.cc:1261] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236 [term 1 FOLLOWER]: Refusing update from remote peer dcf25f45dcb84d2eab8ab4c983c7af1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:44:23.666805 27330 raft_consensus.cc:1261] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663 [term 1 FOLLOWER]: Refusing update from remote peer dcf25f45dcb84d2eab8ab4c983c7af1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:44:23.668244 27634 consensus_queue.cc:1035] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e48de536e58d43d98c99e5645d47d236" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:44:23.668692 27631 consensus_queue.cc:1035] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd2f2b26b1244089bee32b23d245663" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:44:23.682320 27637 mvcc.cc:205] Tried to move back new op lower bound from 7315863403165384704 to 7315863402897051648. Current Snapshot: MvccSnapshot[applied={T|T < 7315863403165384704}]
I20260807 10:44:23.698905 26944 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:44:23.699277 26944 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:44:23.703826 26944 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf766668bc2641d989358858178e7462: Sending DeleteTablet for 3 replicas of tablet e718ec5bc36b434092104c6be7f8e5fb
I20260807 10:44:23.705358 27495 tablet_service.cc:1514] Processing DeleteTablet for tablet e718ec5bc36b434092104c6be7f8e5fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:44:23 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:50832
I20260807 10:44:23.705361 27302 tablet_service.cc:1514] Processing DeleteTablet for tablet e718ec5bc36b434092104c6be7f8e5fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:44:23 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:34204
I20260807 10:44:23.706326 27123 tablet_service.cc:1514] Processing DeleteTablet for tablet e718ec5bc36b434092104c6be7f8e5fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:44:23 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:47092
I20260807 10:44:23.707593 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 27027
I20260807 10:44:23.718935 27648 tablet_replica.cc:330] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: stopping tablet replica
I20260807 10:44:23.719744 27653 tablet_replica.cc:330] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: stopping tablet replica
I20260807 10:44:23.720414 27653 raft_consensus.cc:2229] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:44:23.721139 27653 raft_consensus.cc:2258] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:44:23.722517 27648 raft_consensus.cc:2229] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:44:23.723462 27648 raft_consensus.cc:2258] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:44:23.724613 27650 tablet_replica.cc:330] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: stopping tablet replica
I20260807 10:44:23.725186 27650 raft_consensus.cc:2229] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:44:23.725858 27650 raft_consensus.cc:2258] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:44:23.726715 27653 ts_tablet_manager.cc:1905] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:44:23.726938 27648 ts_tablet_manager.cc:1905] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:44:23.730208 27650 ts_tablet_manager.cc:1905] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:44:23.734911 27653 ts_tablet_manager.cc:1918] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:44:23.734911 27648 ts_tablet_manager.cc:1918] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:44:23.735147 27648 log.cc:1196] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/e718ec5bc36b434092104c6be7f8e5fb
I20260807 10:44:23.735250 27653 log.cc:1196] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/e718ec5bc36b434092104c6be7f8e5fb
I20260807 10:44:23.735900 27653 ts_tablet_manager.cc:1939] T e718ec5bc36b434092104c6be7f8e5fb P e48de536e58d43d98c99e5645d47d236: Deleting consensus metadata
I20260807 10:44:23.735898 27648 ts_tablet_manager.cc:1939] T e718ec5bc36b434092104c6be7f8e5fb P dcf25f45dcb84d2eab8ab4c983c7af1b: Deleting consensus metadata
I20260807 10:44:23.738226 26918 catalog_manager.cc:4841] TS e48de536e58d43d98c99e5645d47d236 (127.11.46.129:33557): tablet e718ec5bc36b434092104c6be7f8e5fb (table test-table [id=038838ddb9fb44d5bf395f69fe444b27]) successfully deleted
I20260807 10:44:23.738204 26920 catalog_manager.cc:4841] TS dcf25f45dcb84d2eab8ab4c983c7af1b (127.11.46.131:44083): tablet e718ec5bc36b434092104c6be7f8e5fb (table test-table [id=038838ddb9fb44d5bf395f69fe444b27]) successfully deleted
I20260807 10:44:23.741228 27650 ts_tablet_manager.cc:1918] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:44:23.741497 27650 log.cc:1196] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/e718ec5bc36b434092104c6be7f8e5fb
Aug 07 10:44:23 dist-test-slave-42z9 krb5kdc[26866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:44:23.742067 27650 ts_tablet_manager.cc:1939] T e718ec5bc36b434092104c6be7f8e5fb P efd2f2b26b1244089bee32b23d245663: Deleting consensus metadata
I20260807 10:44:23.744623 26920 catalog_manager.cc:4841] TS efd2f2b26b1244089bee32b23d245663 (127.11.46.130:36797): tablet e718ec5bc36b434092104c6be7f8e5fb (table test-table [id=038838ddb9fb44d5bf395f69fe444b27]) successfully deleted
I20260807 10:44:23.751874 27616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.709099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47102 (local address 127.11.46.129:33557)
0807 10:44:23.709324 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:23.709331 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:23.722109 (+ 12778us) server_negotiation.cc:407] Connection header received
0807 10:44:23.722462 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:23.722469 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:23.722568 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:23.722651 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:23.724679 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.725842 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.730617 (+ 4775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.731360 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.731491 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.743614 (+ 12123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:23.743640 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:23.743660 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:23.743718 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:23.747976 (+ 4258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:23.749100 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:23.749112 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:23.749116 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:23.749320 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:23.749847 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:23.749853 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:23.749857 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:23.750442 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:23.750801 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:23.751192 (+ 391us) server_negotiation.cc:299] Negotiation successful
0807 10:44:23.751465 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 10:44:23.752645 27205 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:23.849633 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 27027
I20260807 10:44:23.887256 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 27218
Aug 07 10:44:23 dist-test-slave-42z9 krb5kdc[26866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:44:23.906982 27614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:23.888209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34214 (local address 127.11.46.130:36797)
0807 10:44:23.888428 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:23.888434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:23.888455 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:44:23.888518 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:23.888522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:23.888587 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:23.888678 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:23.890049 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.890975 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.892425 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:23.892854 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:23.892980 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:23.898001 (+ 5021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:23.898031 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:23.898059 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:23.898125 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:23.902283 (+ 4158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:23.903237 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:23.903250 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:23.903254 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:23.903447 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:23.903858 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:23.903871 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:23.903874 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:23.904458 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:23.904830 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:23.905909 (+ 1079us) server_negotiation.cc:299] Negotiation successful
0807 10:44:23.906365 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:44:23.908030 27390 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:24.002170 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 27218
I20260807 10:44:24.043426 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 27409
Aug 07 10:44:24 dist-test-slave-42z9 krb5kdc[26866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:44:24.063256 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:44:24.044282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50854 (local address 127.11.46.131:44083)
0807 10:44:24.044464 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 10:44:24.044469 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:44:24.044492 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:44:24.044664 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:44:24.044668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:44:24.044773 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:44:24.044879 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:44:24.046799 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:24.047647 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:24.049688 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:44:24.050201 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:44:24.050339 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:44:24.056468 (+ 6129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:44:24.056484 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:44:24.056502 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:44:24.056555 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:44:24.059793 (+ 3238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:24.060790 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:24.060803 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:24.060805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:24.061002 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:44:24.061471 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:44:24.061476 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:44:24.061479 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:44:24.061884 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:44:24.062201 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0807 10:44:24.062644 (+ 443us) server_negotiation.cc:299] Negotiation successful
0807 10:44:24.062862 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:44:24.064160 27584 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:24.194393 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 27409
I20260807 10:44:24.229517 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 26883
I20260807 10:44:24.230862 26987 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:44:24.347466 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 26883
2026-08-07T10:44:24Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5101 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:44:24 dist-test-slave-42z9 krb5kdc[27662](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:44:24 dist-test-slave-42z9 krb5kdc[27662](info): set up 2 sockets
Aug 07 10:44:24 dist-test-slave-42z9 krb5kdc[27662](info): commencing operation
krb5kdc: starting...
W20260807 10:44:25.608006 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.003s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:44:25 dist-test-slave-42z9 krb5kdc[27662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:44:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:44:25Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.46.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.46.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/rangeradmin_127.11.46.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/rangeradmin_127.11.46.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.46.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.46.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/rangerlookup_127.11.46.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/rangerlookup_127.11.46.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.46.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.46.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/HTTP_127.11.46.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/HTTP_127.11.46.148@KRBTEST.COM.keytab.
I20260807 10:44:26.105526 11450 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasktN6EqJ/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/postgres -l logfile start
2026-08-07 10:44:28.593 UTC [27706] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 10:44:28.593 UTC [27706] LOG: listening on IPv4 address "127.11.46.148", port 35889
2026-08-07 10:44:28.597 UTC [27706] LOG: listening on Unix socket "/tmp/.s.PGSQL.35889"
2026-08-07 10:44:28.618 UTC [27710] LOG: database system was shut down at 2026-08-07 10:44:27 UTC
2026-08-07 10:44:28.622 UTC [27706] LOG: database system is ready to accept connections
I20260807 10:44:29.716773 11450 mini_postgres.cc:96] Postgres bound to 35889
2026-08-07 10:44:29.747 UTC [27720] FATAL: database "slave" does not exist
127.11.46.148:35889 - accepting connections
I20260807 10:44:29.748718 11450 mini_ranger.cc:161] Starting Ranger...
I20260807 10:44:29.788959 11450 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 10:44:30.252394 11450 mini_ranger.cc:87] Created ranger Postgres database
I20260807 10:44:30.252570 11450 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-admin
2026-08-07 10:44:30,602 [I] DB FLAVOR :POSTGRES
2026-08-07 10:44:30,603 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 10:44:30,603 [I] Checking connection..
2026-08-07 10:44:30,603 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 10:44:30,885 [I] Checking connection passed.
2026-08-07 10:44:30,886 [I] --------- Verifying version history table ---------
2026-08-07 10:44:30,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:44:31,173 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 10:44:31,174 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:44:31,425 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 10:44:31,426 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 10:44:31,426 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 10:44:31.680 UTC [27818] WARNING: there is no transaction in progress
2026-08-07 10:44:31,688 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 10:44:31,688 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:44:31,977 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 10:44:31,978 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 10:44:31,978 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 10:44:32,267 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 10:44:32,546 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-42z9.c.gcp-upstream.internal','N') ;"
2026-08-07 10:44:32,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 10:44:33,069 [I] Table x_portal_user does not exist in database ranger
2026-08-07 10:44:33,070 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 10:44:33,353 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 10:44:33,354 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 10:44:33,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 10:44:33,913 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 10:44:33,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 10:44:34.924 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:34.940 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:34.958 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:34.975 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:34.991 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.012 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.071 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.078 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.092 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.102 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.113 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.128 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.138 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.145 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.152 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35.160 UTC [27968] WARNING: there is no transaction in progress
2026-08-07 10:44:35,816 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 10:44:35,817 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 10:44:36,091 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 10:44:36,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 10:44:36,365 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 10:44:36,365 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 10:44:36,644 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 10:44:36,645 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 10:44:36,923 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 10:44:37,198 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-42z9.c.gcp-upstream.internal';"
2026-08-07 10:44:37,473 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 10:44:37,473 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 10:44:37,741 [I] DB_PATCHES have already been applied
I20260807 10:44:37.747992 11450 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-admin:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasktN6EqJ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 10:44:37.748124 11450 mini_ranger.cc:193] Using host: 127.11.46.148
I20260807 10:44:37.775695 11450 mini_ranger.cc:227] Ranger admin URL: http://127.11.46.148:58451
Aug 07, 2026 10:44:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:44:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:44:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 10:44:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 10:44:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 10:44:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 10:44:38 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 10:44:39.033952 11450 mini_ranger.cc:160] Time spent starting Ranger: real 9.285s user 0.004s sys 0.089s
Aug 07, 2026 10:44:59 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 10:44:59 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 10:44:59 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 10:45:00 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 10:45:01 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 10:45:01.787580 11450 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.46.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.46.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/rangerkms_127.11.46.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/rangerkms_127.11.46.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.46.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.46.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.46.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/HTTP_127.11.46.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.46.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/HTTP_127.11.46.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 10:45:02 dist-test-slave-42z9 krb5kdc[27662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099502, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 10:45:02.062726 11450 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 10:45:02.098352 11450 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 10:45:02.902874 11450 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 10:45:02.903034 11450 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-kms
I20260807 10:45:02.903208 11450 mini_ranger_kms.cc:227] Using postgres at 127.11.46.148:35889
2026-08-07 10:45:03,489 [I] DB FLAVOR :POSTGRES
2026-08-07 10:45:03,489 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 10:45:03,489 [I] Checking connection
2026-08-07 10:45:03,489 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 10:45:03,765 [I] connection success
2026-08-07 10:45:03,765 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 10:45:03,765 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 10:45:03,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 10:45:04,022 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 10:45:04,022 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 10:45:04,023 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 10:45:04,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:35889/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 10:45:04,328 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 10:45:04.895326 11450 mini_ranger_kms.cc:310] Created kms service
I20260807 10:45:05.128614 11450 mini_ranger_kms.cc:326] Created kudu user
I20260807 10:45:05.181522 11450 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 10:45:05 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099502, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:45:05.622231 11450 mini_ranger_kms.cc:384] Added ranger policy
I20260807 10:45:05.623844 11450 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-kms:/tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 10:45:05.623939 11450 mini_ranger_kms.cc:240] Using host: 127.11.46.148
I20260807 10:45:05.658488 11450 mini_ranger_kms.cc:276] Ranger KMS PID: 28235
I20260807 10:45:05.658736 11450 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.46.148:45209
Aug 07, 2026 10:45:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:45:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:45:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 10:45:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 10:45:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 10:45:07 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 10:45:07 dist-test-slave-42z9 krb5kdc[27662](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786099507, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.46.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:45:08.278162 11450 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.215s user 0.191s sys 0.472s
I20260807 10:45:08.278498 11450 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 10:45:08.278745 11450 mini_ranger_kms.cc:401] 127.11.46.148:45209/kms/v1/keys
Aug 07 10:45:08 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099507, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.46.148@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
Aug 07 10:45:08 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099507, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.46.148@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
Aug 07 10:45:11 dist-test-slave-42z9 krb5kdc[27662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:45:11.475373 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:46169
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:46169
--ranger_config_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:45209/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:45:11.860610 28318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:45:11.860934 28318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:45:11.861034 28318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:45:11.868636 28318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:45:11.868774 28318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:45:11.868840 28318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:45:11.868898 28318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:45:11.868948 28318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:45:11.879776 28318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.46.148:45209/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:46169
--ranger_config_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:46169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:45:11.881218 28318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:45:11.882684 28318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:45:11.895977 28324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:45:11.896045 28326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:45:11.896070 28323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:45:11.896754 28318 server_base.cc:1034] running on GCE node
I20260807 10:45:11.897748 28318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:45:11.899451 28318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:45:11.900692 28318 hybrid_clock.cc:648] HybridClock initialized: now 1786099511900645 us; error 42 us; skew 500 ppm
I20260807 10:45:11.901093 28318 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:45:11 dist-test-slave-42z9 krb5kdc[27662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099511, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:45:11.904443 28318 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:45:11.906126 28318 webserver.cc:460] Webserver started at http://127.11.46.190:33897/ using document root <none> and password file <none>
I20260807 10:45:11.906906 28318 fs_manager.cc:359] Metadata directory not provided
I20260807 10:45:11.907020 28318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:45:11.907310 28318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:45:11 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099511, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:45:11.970049 28318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9"
format_stamp: "Formatted at 2026-08-07 10:45:11 on dist-test-slave-42z9"
server_key: "6b94f908f12092508c4abb69587bf08c"
server_key_iv: "555b8493e5efa4ad8d2761a6962a1290"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:11.971019 28318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9"
format_stamp: "Formatted at 2026-08-07 10:45:11 on dist-test-slave-42z9"
server_key: "6b94f908f12092508c4abb69587bf08c"
server_key_iv: "555b8493e5efa4ad8d2761a6962a1290"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:11.977115 28318 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:45:11.996762 28338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:45:11.998409 28318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:45:11.998584 28318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9"
format_stamp: "Formatted at 2026-08-07 10:45:11 on dist-test-slave-42z9"
server_key: "6b94f908f12092508c4abb69587bf08c"
server_key_iv: "555b8493e5efa4ad8d2761a6962a1290"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:11.998817 28318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:45:12.039410 28318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:45:12.043984 28318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:45:12.044323 28318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:45:12.064090 28318 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:46169
I20260807 10:45:12.064108 28410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:46169 every 8 connection(s)
I20260807 10:45:12.065687 28318 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:45:12.069926 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 28318
I20260807 10:45:12.070118 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:45:12.070127 28412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:45:12.070827 11450 external_mini_cluster.cc:1428] Setting key 41bed322db0ab87aa66091437251daa6
Aug 07 10:45:12 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:45:12.085513 28412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9: Bootstrap starting.
I20260807 10:45:12.089677 28412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9: Neither blocks nor log segments found. Creating new log.
I20260807 10:45:12.091195 28412 log.cc:824] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9: Log is configured to *not* fsync() on all Append() calls
I20260807 10:45:12.095064 28412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9: No bootstrap required, opened a new log
I20260807 10:45:12.095270 28417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:12.072929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35196 (local address 127.11.46.190:46169)
0807 10:45:12.073866 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:12.073878 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:12.073923 (+ 45us) server_negotiation.cc:407] Connection header received
0807 10:45:12.075512 (+ 1589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:12.075540 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:12.075949 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:12.076321 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:45:12.077998 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:12.079362 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:12.081141 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:12.081955 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:12.082110 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:12.086872 (+ 4762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:45:12.086882 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:45:12.086899 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:45:12.086952 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:45:12.090294 (+ 3342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:12.091307 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:12.091315 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:12.091322 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:12.091541 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:12.092066 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:12.092071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:12.092074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:12.092936 (+ 862us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:45:12.093203 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:12.093715 (+ 512us) server_negotiation.cc:299] Negotiation successful
0807 10:45:12.094122 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":697,"thread_start_us":433,"threads_started":1}
I20260807 10:45:12.103531 28412 raft_consensus.cc:348] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46169 } }
I20260807 10:45:12.104039 28412 raft_consensus.cc:374] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:45:12.104153 28412 raft_consensus.cc:729] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85dddf0ceacd4c83b9b92ee8ea9ad0e9, State: Initialized, Role: FOLLOWER
I20260807 10:45:12.104933 28412 consensus_queue.cc:260] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46169 } }
I20260807 10:45:12.105258 28412 raft_consensus.cc:388] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:45:12.105432 28412 raft_consensus.cc:482] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:45:12.105654 28412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:45:12.108114 28412 raft_consensus.cc:504] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46169 } }
I20260807 10:45:12.108745 28412 leader_election.cc:302] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 85dddf0ceacd4c83b9b92ee8ea9ad0e9; no voters:
I20260807 10:45:12.109395 28412 leader_election.cc:288] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:45:12.109573 28419 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:45:12.110342 28419 raft_consensus.cc:686] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [term 1 LEADER]: Becoming Leader. State: Replica: 85dddf0ceacd4c83b9b92ee8ea9ad0e9, State: Running, Role: LEADER
I20260807 10:45:12.111115 28419 consensus_queue.cc:237] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46169 } }
I20260807 10:45:12.112047 28412 sys_catalog.cc:564] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:45:12.114683 28420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46169 } } }
I20260807 10:45:12.115124 28420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [sys.catalog]: This master's current role is: LEADER
I20260807 10:45:12.115859 28421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 85dddf0ceacd4c83b9b92ee8ea9ad0e9. Latest consensus state: current_term: 1 leader_uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "85dddf0ceacd4c83b9b92ee8ea9ad0e9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46169 } } }
I20260807 10:45:12.116189 28421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9 [sys.catalog]: This master's current role is: LEADER
I20260807 10:45:12.118105 28429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:45:12.124215 28429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:45:12.125206 28412 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 10:45:12.146415 28429 catalog_manager.cc:1347] Generated new cluster ID: ab88f2eb88d34b85b4703ccbab89f5f9
I20260807 10:45:12.146581 28429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:45:12.161235 28429 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:45:12.163435 28429 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:45:12.171566 28429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9: Generated new TSK 0
I20260807 10:45:12.172860 28429 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:45:12.989820 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:45209/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46169
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:45:13 dist-test-slave-42z9 krb5kdc[27662](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786099513, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 10:45:13.512735 28483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:45:13.513136 28483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:45:13.513309 28483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:45:13.521695 28483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:45:13.521857 28483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:45:13.522047 28483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:45:13.533274 28483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.46.148:45209/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:45:13.534976 28483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:45:13.536612 28483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:45:13.555151 28495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:45:13.556371 28497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:45:13.565325 28503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:45:13.565726 28483 server_base.cc:1034] running on GCE node
I20260807 10:45:13.566749 28483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:45:13.574615 28483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:45:13.576013 28483 hybrid_clock.cc:648] HybridClock initialized: now 1786099513575883 us; error 135 us; skew 500 ppm
I20260807 10:45:13.576581 28483 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:45:13 dist-test-slave-42z9 krb5kdc[27662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099513, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:45:13.581511 28483 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:45:13.589089 28483 webserver.cc:460] Webserver started at http://127.11.46.129:37143/ using document root <none> and password file <none>
I20260807 10:45:13.590338 28483 fs_manager.cc:359] Metadata directory not provided
I20260807 10:45:13.590559 28483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:45:13.591002 28483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:45:13 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099513, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:45:13.613294 28483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "f800f422551a4eaf96ffcfdd96ab8ba9"
format_stamp: "Formatted at 2026-08-07 10:45:13 on dist-test-slave-42z9"
server_key: "38f493faad260f3fe7edc18157630231"
server_key_iv: "88dfe186b4dd5f2ff48d137134ef50ea"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:13.614526 28483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "f800f422551a4eaf96ffcfdd96ab8ba9"
format_stamp: "Formatted at 2026-08-07 10:45:13 on dist-test-slave-42z9"
server_key: "38f493faad260f3fe7edc18157630231"
server_key_iv: "88dfe186b4dd5f2ff48d137134ef50ea"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:13.621897 28483 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260807 10:45:13.643076 28512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:45:13.655474 28483 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.003s sys 0.002s
I20260807 10:45:13.655922 28483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "f800f422551a4eaf96ffcfdd96ab8ba9"
format_stamp: "Formatted at 2026-08-07 10:45:13 on dist-test-slave-42z9"
server_key: "38f493faad260f3fe7edc18157630231"
server_key_iv: "88dfe186b4dd5f2ff48d137134ef50ea"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:13.656363 28483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:45:13.720778 28483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:45:13.727339 28483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:45:13.727856 28483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:45:13.746306 28483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:45:13.755224 28483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:45:13.755491 28483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 10:45:13.755760 28483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:45:13.755915 28483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 10:45:13 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099513, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:45:13.838527 28483 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:36881
I20260807 10:45:13.838560 28681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:36881 every 8 connection(s)
I20260807 10:45:13.840677 28483 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:45:13.846426 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 28483
I20260807 10:45:13.846680 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:45:13.847549 11450 external_mini_cluster.cc:1428] Setting key 12deb9d0870c2515cdc7ebab7d49281b
Aug 07 10:45:13 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099513, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:45:13.883834 28686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:13.844078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:56795 (local address 127.11.46.190:46169)
0807 10:45:13.855883 (+ 11805us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:13.855890 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:13.861532 (+ 5642us) server_negotiation.cc:407] Connection header received
0807 10:45:13.862856 (+ 1324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:13.862862 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:13.862988 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:13.863109 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:45:13.865761 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:13.866813 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:13.869505 (+ 2692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:13.870176 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:13.870295 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:13.875325 (+ 5030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:45:13.875332 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:45:13.875337 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:45:13.875385 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:45:13.879191 (+ 3806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:13.880571 (+ 1380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:13.880578 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:13.880581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:13.880778 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:13.881429 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:13.881435 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:13.881460 (+ 25us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:13.881819 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:45:13.881967 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:13.883171 (+ 1204us) server_negotiation.cc:299] Negotiation successful
0807 10:45:13.883463 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11646,"thread_start_us":11485,"threads_started":1}
I20260807 10:45:13.886952 28687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:13.844716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46169 (local address 127.11.46.129:56795)
0807 10:45:13.859692 (+ 14976us) negotiation.cc:107] Waiting for socket to connect
0807 10:45:13.859754 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 10:45:13.862315 (+ 2561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:45:13.863775 (+ 1460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:45:13.863789 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:45:13.864489 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:45:13.865476 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:13.865513 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:13.867096 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:13.867101 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:13.869229 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:13.869262 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:13.870753 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:13.870762 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:13.871105 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:13.871966 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:45:13.872002 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:45:13.874957 (+ 2955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:45:13.879524 (+ 4567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:45:13.879537 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:45:13.879562 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:45:13.880375 (+ 813us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:45:13.880964 (+ 589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:45:13.880968 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:45:13.880971 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:45:13.881290 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:45:13.882107 (+ 817us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:45:13.882117 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:45:13.882685 (+ 568us) client_negotiation.cc:769] Sending connection context
0807 10:45:13.884491 (+ 1806us) client_negotiation.cc:240] Negotiation successful
0807 10:45:13.885286 (+ 795us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14626,"thread_start_us":13343,"threads_started":1}
I20260807 10:45:13.889706 28682 heartbeater.cc:347] Connected to a master server at 127.11.46.190:46169
I20260807 10:45:13.890161 28682 heartbeater.cc:464] Registering TS with master...
I20260807 10:45:13.891285 28682 heartbeater.cc:511] Master 127.11.46.190:46169 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
I20260807 10:45:13.894742 28361 ts_manager.cc:194] Registered new tserver with Master: f800f422551a4eaf96ffcfdd96ab8ba9 (127.11.46.129:36881)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
I20260807 10:45:13.896732 28361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:56795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:45:13.947042 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:45209/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46169
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:45:14 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099513, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
W20260807 10:45:14.469357 28691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:45:14.469998 28691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:45:14.470232 28691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:45:14.482108 28691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:45:14.482280 28691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:45:14.482446 28691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:45:14.498971 28691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.46.148:45209/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:45:14.501132 28691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:45:14.503276 28691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:45:14.541201 28704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:45:14.543262 28711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:45:14.545068 28691 server_base.cc:1034] running on GCE node
W20260807 10:45:14.545912 28715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:45:14.546752 28691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:45:14.547947 28691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:45:14.549196 28691 hybrid_clock.cc:648] HybridClock initialized: now 1786099514549127 us; error 60 us; skew 500 ppm
I20260807 10:45:14.549636 28691 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:45:14 dist-test-slave-42z9 krb5kdc[27662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099514, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:45:14.553372 28691 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:45:14.555366 28691 webserver.cc:460] Webserver started at http://127.11.46.130:34285/ using document root <none> and password file <none>
I20260807 10:45:14.556213 28691 fs_manager.cc:359] Metadata directory not provided
I20260807 10:45:14.556339 28691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:45:14.556710 28691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:45:14 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099514, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:45:14.577481 28691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "25bceb7630db42958dcc07b49eb4d2aa"
format_stamp: "Formatted at 2026-08-07 10:45:14 on dist-test-slave-42z9"
server_key: "adf88f88142cb4069ef1ea352c0d8ce5"
server_key_iv: "036b37334ee75ede04c48542aaf5c2c2"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:14.578795 28691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "25bceb7630db42958dcc07b49eb4d2aa"
format_stamp: "Formatted at 2026-08-07 10:45:14 on dist-test-slave-42z9"
server_key: "adf88f88142cb4069ef1ea352c0d8ce5"
server_key_iv: "036b37334ee75ede04c48542aaf5c2c2"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:14.586715 28691 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
I20260807 10:45:14.607859 28734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:45:14.609951 28691 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 10:45:14.610196 28691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "25bceb7630db42958dcc07b49eb4d2aa"
format_stamp: "Formatted at 2026-08-07 10:45:14 on dist-test-slave-42z9"
server_key: "adf88f88142cb4069ef1ea352c0d8ce5"
server_key_iv: "036b37334ee75ede04c48542aaf5c2c2"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:14.610512 28691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:45:14.646739 28691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:45:14.652268 28691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:45:14.652665 28691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:45:14.653998 28691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:45:14.656028 28691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:45:14.656137 28691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:45:14.656270 28691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:45:14.656332 28691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:45:14.691155 28691 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:43139
I20260807 10:45:14.691174 28903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:43139 every 8 connection(s)
I20260807 10:45:14.692900 28691 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:45:14.699756 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 28691
I20260807 10:45:14.699954 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:45:14.700455 11450 external_mini_cluster.cc:1428] Setting key 87d2a5a23e069e2cb4dbc01f0627a6cf
Aug 07 10:45:14 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099514, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:45:14.719636 28906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:14.695919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:60451 (local address 127.11.46.190:46169)
0807 10:45:14.696441 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:14.696447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:14.697649 (+ 1202us) server_negotiation.cc:407] Connection header received
0807 10:45:14.699720 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:14.699726 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:14.699818 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:14.699933 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:45:14.702147 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:14.703260 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:14.705794 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:14.706464 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:14.706606 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:14.711237 (+ 4631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:45:14.711243 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:45:14.711248 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:45:14.711297 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:45:14.714758 (+ 3461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:14.715928 (+ 1170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:14.715934 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:14.715937 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:14.716158 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:14.716859 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:14.716865 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:14.716868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:14.717483 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:45:14.717686 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:14.718876 (+ 1190us) server_negotiation.cc:299] Negotiation successful
0807 10:45:14.719184 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":266,"threads_started":1}
I20260807 10:45:14.721077 28907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:14.696593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46169 (local address 127.11.46.130:60451)
0807 10:45:14.697478 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0807 10:45:14.697533 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 10:45:14.699324 (+ 1791us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:45:14.700395 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:45:14.700407 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:45:14.701056 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:45:14.701939 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:14.701967 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:14.703455 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:14.703461 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:14.705563 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:14.705593 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:14.706760 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:14.706768 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:14.707083 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:14.707931 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:45:14.707970 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:45:14.710913 (+ 2943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:45:14.714990 (+ 4077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:45:14.715003 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:45:14.715027 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:45:14.715748 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:45:14.716297 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:45:14.716302 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:45:14.716305 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:45:14.716690 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:45:14.717655 (+ 965us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:45:14.717667 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:45:14.718293 (+ 626us) client_negotiation.cc:769] Sending connection context
0807 10:45:14.718726 (+ 433us) client_negotiation.cc:240] Negotiation successful
0807 10:45:14.719400 (+ 674us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":344,"threads_started":1}
I20260807 10:45:14.722944 28904 heartbeater.cc:347] Connected to a master server at 127.11.46.190:46169
I20260807 10:45:14.723340 28904 heartbeater.cc:464] Registering TS with master...
I20260807 10:45:14.724248 28904 heartbeater.cc:511] Master 127.11.46.190:46169 requested a full tablet report, sending...
I20260807 10:45:14.726094 28361 ts_manager.cc:194] Registered new tserver with Master: 25bceb7630db42958dcc07b49eb4d2aa (127.11.46.130:43139)
I20260807 10:45:14.727166 28361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:60451
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:45:14.793480 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:45209/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46169
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:38639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:45:14.901162 28682 heartbeater.cc:503] Master 127.11.46.190:46169 was elected leader, sending a full tablet report...
W20260807 10:45:15.211630 28912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:45:15.211966 28912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:45:15.212112 28912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:45:15.220124 28912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:45:15.220280 28912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:45:15.220448 28912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:45:15.231271 28912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:38639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.46.148:45209/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:45:15.232869 28912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:45:15.234509 28912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:45:15.249825 28919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:45:15.249890 28920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:45:15.249799 28924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:45:15.255196 28912 server_base.cc:1034] running on GCE node
I20260807 10:45:15.255964 28912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:45:15.257139 28912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:45:15.258380 28912 hybrid_clock.cc:648] HybridClock initialized: now 1786099515258292 us; error 80 us; skew 500 ppm
I20260807 10:45:15.258781 28912 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:45:15 dist-test-slave-42z9 krb5kdc[27662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:45:15.262324 28912 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:45:15.264240 28912 webserver.cc:460] Webserver started at http://127.11.46.131:37885/ using document root <none> and password file <none>
I20260807 10:45:15.265159 28912 fs_manager.cc:359] Metadata directory not provided
I20260807 10:45:15.265301 28912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:45:15.265718 28912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:45:15 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:45:15.282099 28912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "a67469c446474b8a9245243b8ba112bb"
format_stamp: "Formatted at 2026-08-07 10:45:15 on dist-test-slave-42z9"
server_key: "2c173ae537810611783a045304517847"
server_key_iv: "338104d60791bd35245f88f4004bd23c"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:15.283517 28912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "a67469c446474b8a9245243b8ba112bb"
format_stamp: "Formatted at 2026-08-07 10:45:15 on dist-test-slave-42z9"
server_key: "2c173ae537810611783a045304517847"
server_key_iv: "338104d60791bd35245f88f4004bd23c"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:15.291766 28912 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260807 10:45:15.309008 28936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:45:15.310951 28912 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260807 10:45:15.311198 28912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "a67469c446474b8a9245243b8ba112bb"
format_stamp: "Formatted at 2026-08-07 10:45:15 on dist-test-slave-42z9"
server_key: "2c173ae537810611783a045304517847"
server_key_iv: "338104d60791bd35245f88f4004bd23c"
server_key_version: "kuduclusterkey@0"
I20260807 10:45:15.311486 28912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:45:15.326236 28912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:45:15.330829 28912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:45:15.331163 28912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:45:15.332234 28912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:45:15.333921 28912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:45:15.334012 28912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:45:15.334126 28912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:45:15.334172 28912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:45:15.368443 28912 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:40813
I20260807 10:45:15.368479 29107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:40813 every 8 connection(s)
I20260807 10:45:15.370033 28912 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:45:15.377729 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 28912
I20260807 10:45:15.377920 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:45:15.378363 11450 external_mini_cluster.cc:1428] Setting key 063d10cf1dab2c3b52102e792e7b526d
Aug 07 10:45:15 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099515, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:45:15.393138 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.373386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:38865 (local address 127.11.46.190:46169)
0807 10:45:15.374029 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:15.374034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:15.374764 (+ 730us) server_negotiation.cc:407] Connection header received
0807 10:45:15.376803 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:15.376810 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:15.376903 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:15.377011 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:45:15.378953 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.379913 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.381932 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.382426 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.382557 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.386252 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:45:15.386258 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:45:15.386262 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:45:15.386303 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:45:15.389251 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:15.390312 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:15.390317 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:15.390320 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:15.390494 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:15.391048 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:15.391055 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:15.391058 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:15.391399 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:45:15.391553 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:15.392413 (+ 860us) server_negotiation.cc:299] Negotiation successful
0807 10:45:15.392724 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":294,"threads_started":1}
I20260807 10:45:15.394433 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.373762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46169 (local address 127.11.46.131:38865)
0807 10:45:15.374573 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0807 10:45:15.374625 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 10:45:15.376452 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:45:15.377320 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:45:15.377330 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:45:15.377962 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:45:15.378732 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.378756 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.380094 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.380098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.381757 (+ 1659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.381782 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.382681 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.382689 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.382956 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.383691 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:45:15.383718 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:45:15.385947 (+ 2229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:45:15.389505 (+ 3558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:45:15.389516 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:45:15.389535 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:45:15.390142 (+ 607us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:45:15.390627 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:45:15.390633 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:45:15.390635 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:45:15.390905 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:45:15.391553 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:45:15.391563 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:45:15.391986 (+ 423us) client_negotiation.cc:769] Sending connection context
0807 10:45:15.392265 (+ 279us) client_negotiation.cc:240] Negotiation successful
0807 10:45:15.392910 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":333,"threads_started":1}
I20260807 10:45:15.395982 29108 heartbeater.cc:347] Connected to a master server at 127.11.46.190:46169
I20260807 10:45:15.396337 29108 heartbeater.cc:464] Registering TS with master...
I20260807 10:45:15.397215 29108 heartbeater.cc:511] Master 127.11.46.190:46169 requested a full tablet report, sending...
I20260807 10:45:15.399036 28361 ts_manager.cc:194] Registered new tserver with Master: a67469c446474b8a9245243b8ba112bb (127.11.46.131:40813)
I20260807 10:45:15.399937 28361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:38865
I20260807 10:45:15.407437 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:45:15.427755 29110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.412551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35206 (local address 127.11.46.190:46169)
0807 10:45:15.412773 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:15.412780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:15.413231 (+ 451us) server_negotiation.cc:407] Connection header received
0807 10:45:15.413492 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:15.413497 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:15.413594 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:15.413692 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:45:15.415285 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.416146 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.417898 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.418424 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.418565 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.421314 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:45:15.421320 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:45:15.421324 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:45:15.421373 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:45:15.423943 (+ 2570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:15.425061 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:15.425069 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:15.425072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:15.425305 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:15.425919 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:15.425925 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:15.425928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:15.426390 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:45:15.426670 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:15.427153 (+ 483us) server_negotiation.cc:299] Negotiation successful
0807 10:45:15.427480 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:45:15.433211 28361 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35206:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:45:15.441193 28361 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:45:15.469959 29129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.458891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52906 (local address 127.11.46.130:43139)
0807 10:45:15.459665 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:15.459677 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:15.460199 (+ 522us) server_negotiation.cc:407] Connection header received
0807 10:45:15.460517 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:15.460524 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:15.460851 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:15.461073 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:45:15.462215 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.463831 (+ 1616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.466779 (+ 2948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.468445 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.468582 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.468847 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:15.469316 (+ 469us) server_negotiation.cc:299] Negotiation successful
0807 10:45:15.469545 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":390,"threads_started":1}
I20260807 10:45:15.470010 29128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.458702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:43139 (local address 127.0.0.1:52906)
0807 10:45:15.460018 (+ 1316us) negotiation.cc:107] Waiting for socket to connect
0807 10:45:15.460067 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 10:45:15.460275 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:45:15.461473 (+ 1198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:45:15.461481 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:45:15.461513 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:45:15.461970 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.461986 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.464074 (+ 2088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.464080 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.466540 (+ 2460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.466559 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.468702 (+ 2143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.468712 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.469033 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.469081 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 10:45:15.469217 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 10:45:15.469521 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1083,"mutex_wait_us":45,"thread_start_us":936,"threads_started":1}
I20260807 10:45:15.471267 29133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.460459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:40813 (local address 127.0.0.1:36972)
0807 10:45:15.461079 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0807 10:45:15.461100 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:45:15.461220 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:45:15.462579 (+ 1359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:45:15.462585 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:45:15.462617 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:45:15.463078 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.463092 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.465601 (+ 2509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.465607 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.467625 (+ 2018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.467640 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.469611 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.469619 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.469816 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.469856 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 10:45:15.469925 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 10:45:15.470076 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":1,"thread_start_us":322,"threads_started":1}
I20260807 10:45:15.472383 29134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.460909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36972 (local address 127.11.46.131:40813)
0807 10:45:15.461871 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:15.461881 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:15.461918 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:45:15.462025 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:15.462035 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:15.462321 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:15.463397 (+ 1076us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:45:15.463770 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.465468 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.467826 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.469302 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.471564 (+ 2262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.471866 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:15.471938 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 10:45:15.472091 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":2038,"threads_started":1}
I20260807 10:45:15.473805 29136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.461150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:36881 (local address 127.0.0.1:32830)
0807 10:45:15.464282 (+ 3132us) negotiation.cc:107] Waiting for socket to connect
0807 10:45:15.464303 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:45:15.464497 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:45:15.465287 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:45:15.465292 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:45:15.465323 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:45:15.466172 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.466187 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.468350 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.468355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.470600 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.470617 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.472977 (+ 2360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.472985 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.473171 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.473207 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 10:45:15.473305 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 10:45:15.473491 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2989,"mutex_wait_us":42,"thread_start_us":2819,"threads_started":1}
I20260807 10:45:15.474519 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.461796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32830 (local address 127.11.46.129:36881)
0807 10:45:15.463770 (+ 1974us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:15.463780 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:15.464483 (+ 703us) server_negotiation.cc:407] Connection header received
0807 10:45:15.464715 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:15.464726 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:15.465023 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:15.465277 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:45:15.466455 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.468120 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.470819 (+ 2699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.472566 (+ 1747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.472709 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.472953 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:15.473421 (+ 468us) server_negotiation.cc:299] Negotiation successful
0807 10:45:15.474244 (+ 823us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1779,"thread_start_us":1591,"threads_started":1}
I20260807 10:45:15.475401 28813 tablet_service.cc:1467] Processing CreateTablet for tablet 54afdb181f174a8ba7ef956a7dd13125 (DEFAULT_TABLE table=test-table [id=788b0ebe663f417197c89ae059691c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:45:15.477538 28813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54afdb181f174a8ba7ef956a7dd13125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:45:15.476873 29006 tablet_service.cc:1467] Processing CreateTablet for tablet 54afdb181f174a8ba7ef956a7dd13125 (DEFAULT_TABLE table=test-table [id=788b0ebe663f417197c89ae059691c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:45:15.478809 29006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54afdb181f174a8ba7ef956a7dd13125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:45:15.478546 28588 tablet_service.cc:1467] Processing CreateTablet for tablet 54afdb181f174a8ba7ef956a7dd13125 (DEFAULT_TABLE table=test-table [id=788b0ebe663f417197c89ae059691c8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:45:15.479988 28588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54afdb181f174a8ba7ef956a7dd13125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:45:15.493392 29139 tablet_bootstrap.cc:492] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: Bootstrap starting.
I20260807 10:45:15.497179 29139 tablet_bootstrap.cc:654] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: Neither blocks nor log segments found. Creating new log.
I20260807 10:45:15.498298 29140 tablet_bootstrap.cc:492] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: Bootstrap starting.
I20260807 10:45:15.498787 29139 log.cc:824] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: Log is configured to *not* fsync() on all Append() calls
I20260807 10:45:15.499387 29141 tablet_bootstrap.cc:492] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: Bootstrap starting.
I20260807 10:45:15.503389 29139 tablet_bootstrap.cc:492] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: No bootstrap required, opened a new log
I20260807 10:45:15.503760 29139 ts_tablet_manager.cc:1397] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260807 10:45:15.504040 29140 tablet_bootstrap.cc:654] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: Neither blocks nor log segments found. Creating new log.
I20260807 10:45:15.504036 29141 tablet_bootstrap.cc:654] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: Neither blocks nor log segments found. Creating new log.
I20260807 10:45:15.505601 29140 log.cc:824] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: Log is configured to *not* fsync() on all Append() calls
I20260807 10:45:15.505600 29141 log.cc:824] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: Log is configured to *not* fsync() on all Append() calls
I20260807 10:45:15.509292 29140 tablet_bootstrap.cc:492] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: No bootstrap required, opened a new log
I20260807 10:45:15.509404 29141 tablet_bootstrap.cc:492] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: No bootstrap required, opened a new log
I20260807 10:45:15.509685 29140 ts_tablet_manager.cc:1397] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260807 10:45:15.509755 29141 ts_tablet_manager.cc:1397] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.002s
I20260807 10:45:15.514933 29139 raft_consensus.cc:348] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 } } peers { permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 } } peers { permanent_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 36881 } }
I20260807 10:45:15.515568 29139 raft_consensus.cc:374] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:45:15.515780 29139 raft_consensus.cc:729] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f800f422551a4eaf96ffcfdd96ab8ba9, State: Initialized, Role: FOLLOWER
I20260807 10:45:15.516824 29139 consensus_queue.cc:260] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 } } peers { permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 } } peers { permanent_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 36881 } }
I20260807 10:45:15.519563 29139 ts_tablet_manager.cc:1428] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260807 10:45:15.519444 29140 raft_consensus.cc:348] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 } } peers { permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 } } peers { permanent_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 36881 } }
I20260807 10:45:15.520010 29140 raft_consensus.cc:374] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:45:15.520147 29140 raft_consensus.cc:729] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25bceb7630db42958dcc07b49eb4d2aa, State: Initialized, Role: FOLLOWER
I20260807 10:45:15.520872 29140 consensus_queue.cc:260] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 } } peers { permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 } } peers { permanent_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 36881 } }
I20260807 10:45:15.521245 29141 raft_consensus.cc:348] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 } } peers { permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 } } peers { permanent_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 36881 } }
I20260807 10:45:15.521796 29141 raft_consensus.cc:374] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:45:15.521922 29141 raft_consensus.cc:729] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67469c446474b8a9245243b8ba112bb, State: Initialized, Role: FOLLOWER
I20260807 10:45:15.522303 28904 heartbeater.cc:503] Master 127.11.46.190:46169 was elected leader, sending a full tablet report...
I20260807 10:45:15.522799 29140 ts_tablet_manager.cc:1428] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260807 10:45:15.523504 29141 consensus_queue.cc:260] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 } } peers { permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 } } peers { permanent_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 36881 } }
I20260807 10:45:15.526335 29108 heartbeater.cc:503] Master 127.11.46.190:46169 was elected leader, sending a full tablet report...
I20260807 10:45:15.527791 29141 ts_tablet_manager.cc:1428] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: Time spent starting tablet: real 0.018s user 0.009s sys 0.006s
I20260807 10:45:15.600374 29149 raft_consensus.cc:482] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:45:15.600719 29149 raft_consensus.cc:504] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 } } peers { permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 } } peers { permanent_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 36881 } }
I20260807 10:45:15.602758 29149 leader_election.cc:288] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25bceb7630db42958dcc07b49eb4d2aa (127.11.46.130:43139), a67469c446474b8a9245243b8ba112bb (127.11.46.131:40813)
W20260807 10:45:15.609794 28685 tablet.cc:2369] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:45:15.611142 29129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.603269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:37277 (local address 127.11.46.130:43139)
0807 10:45:15.603489 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:15.603494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:15.604104 (+ 610us) server_negotiation.cc:407] Connection header received
0807 10:45:15.604338 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:15.604343 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:15.604434 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:15.604541 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:45:15.605239 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.606281 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.608789 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.610117 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.610274 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.610358 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:15.610728 (+ 370us) server_negotiation.cc:299] Negotiation successful
0807 10:45:15.610879 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:45:15.611294 29152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.603315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:43139 (local address 127.11.46.129:37277)
0807 10:45:15.603963 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0807 10:45:15.603980 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:45:15.604168 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:45:15.604649 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:45:15.604655 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:45:15.604689 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:45:15.605074 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.605088 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.606482 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.606491 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.608617 (+ 2126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.608633 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.610359 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.610366 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.610553 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.610583 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:45:15.610673 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 10:45:15.610827 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"mutex_wait_us":49,"thread_start_us":348,"threads_started":1}
I20260807 10:45:15.612028 29134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.604305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:56113 (local address 127.11.46.131:40813)
0807 10:45:15.604540 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:15.604545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:15.604996 (+ 451us) server_negotiation.cc:407] Connection header received
0807 10:45:15.605158 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:15.605165 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:15.605248 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:15.605323 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:45:15.606185 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.607491 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.609819 (+ 2328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.611041 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.611219 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.611301 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:15.611682 (+ 381us) server_negotiation.cc:299] Negotiation successful
0807 10:45:15.611829 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:45:15.612175 29154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.604123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:40813 (local address 127.11.46.129:56113)
0807 10:45:15.604888 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0807 10:45:15.604908 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:45:15.605032 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:45:15.605381 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:45:15.605386 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:45:15.605414 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:45:15.605854 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.605866 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.607686 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.607691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.609603 (+ 1912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:45:15.609621 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.611318 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.611324 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:45:15.611496 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.611528 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 10:45:15.611628 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 10:45:15.611744 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"mutex_wait_us":41,"thread_start_us":420,"threads_started":1}
I20260807 10:45:15.612723 28836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54afdb181f174a8ba7ef956a7dd13125" candidate_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25bceb7630db42958dcc07b49eb4d2aa" is_pre_election: true
I20260807 10:45:15.613240 28836 raft_consensus.cc:2454] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f800f422551a4eaf96ffcfdd96ab8ba9 in term 0.
I20260807 10:45:15.614128 28519 leader_election.cc:302] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25bceb7630db42958dcc07b49eb4d2aa, f800f422551a4eaf96ffcfdd96ab8ba9; no voters:
I20260807 10:45:15.614684 29149 raft_consensus.cc:2781] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:45:15.614835 29149 raft_consensus.cc:482] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:45:15.614943 29149 raft_consensus.cc:3037] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:45:15.614723 29036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54afdb181f174a8ba7ef956a7dd13125" candidate_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67469c446474b8a9245243b8ba112bb" is_pre_election: true
I20260807 10:45:15.615309 29036 raft_consensus.cc:2454] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f800f422551a4eaf96ffcfdd96ab8ba9 in term 0.
I20260807 10:45:15.618134 29149 raft_consensus.cc:504] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 } } peers { permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 } } peers { permanent_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 36881 } }
I20260807 10:45:15.618834 29149 leader_election.cc:288] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [CANDIDATE]: Term 1 election: Requested vote from peers 25bceb7630db42958dcc07b49eb4d2aa (127.11.46.130:43139), a67469c446474b8a9245243b8ba112bb (127.11.46.131:40813)
I20260807 10:45:15.619410 29036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54afdb181f174a8ba7ef956a7dd13125" candidate_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a67469c446474b8a9245243b8ba112bb"
I20260807 10:45:15.619402 28836 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54afdb181f174a8ba7ef956a7dd13125" candidate_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25bceb7630db42958dcc07b49eb4d2aa"
I20260807 10:45:15.619658 29036 raft_consensus.cc:3037] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:45:15.619658 28836 raft_consensus.cc:3037] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa [term 0 FOLLOWER]: Advancing to term 1
W20260807 10:45:15.621829 29109 tablet.cc:2369] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:45:15.623122 29036 raft_consensus.cc:2454] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f800f422551a4eaf96ffcfdd96ab8ba9 in term 1.
I20260807 10:45:15.623122 28836 raft_consensus.cc:2454] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f800f422551a4eaf96ffcfdd96ab8ba9 in term 1.
I20260807 10:45:15.623620 28519 leader_election.cc:302] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a67469c446474b8a9245243b8ba112bb, f800f422551a4eaf96ffcfdd96ab8ba9; no voters:
I20260807 10:45:15.623945 29149 raft_consensus.cc:2781] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:45:15.624435 29149 raft_consensus.cc:686] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 1 LEADER]: Becoming Leader. State: Replica: f800f422551a4eaf96ffcfdd96ab8ba9, State: Running, Role: LEADER
I20260807 10:45:15.625227 29149 consensus_queue.cc:237] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 } } peers { permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 } } peers { permanent_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 36881 } }
I20260807 10:45:15.630244 28359 catalog_manager.cc:5495] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f800f422551a4eaf96ffcfdd96ab8ba9 (127.11.46.129). New cstate: current_term: 1 leader_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f800f422551a4eaf96ffcfdd96ab8ba9" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 36881 } health_report { overall_health: HEALTHY } } }
I20260807 10:45:15.669201 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.663152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32838 (local address 127.11.46.129:36881)
0807 10:45:15.663357 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:15.663362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:15.663383 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:45:15.663557 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:15.663561 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:15.663650 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:15.663789 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:45:15.664146 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.664961 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.666603 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.667372 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.667501 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.668018 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:45:15.668597 (+ 579us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:45:15.668724 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:15.668808 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 10:45:15.668896 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:45:15.678778 28836 raft_consensus.cc:1261] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa [term 1 FOLLOWER]: Refusing update from remote peer f800f422551a4eaf96ffcfdd96ab8ba9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:45:15.678778 29036 raft_consensus.cc:1261] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb [term 1 FOLLOWER]: Refusing update from remote peer f800f422551a4eaf96ffcfdd96ab8ba9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:45:15.679999 29157 consensus_queue.cc:1035] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a67469c446474b8a9245243b8ba112bb" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:45:15.680406 29149 consensus_queue.cc:1035] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25bceb7630db42958dcc07b49eb4d2aa" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 43139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:45:15.695122 29162 mvcc.cc:205] Tried to move back new op lower bound from 7315863616207425536 to 7315863616005300224. Current Snapshot: MvccSnapshot[applied={T|T < 7315863616207425536}]
W20260807 10:45:15.695423 28905 tablet.cc:2369] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:45:15.695528 29161 mvcc.cc:205] Tried to move back new op lower bound from 7315863616207425536 to 7315863616005300224. Current Snapshot: MvccSnapshot[applied={T|T < 7315863616207425536}]
I20260807 10:45:15.712038 28359 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:45:15.712406 28359 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35206:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:45:15.717123 28359 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 85dddf0ceacd4c83b9b92ee8ea9ad0e9: Sending DeleteTablet for 3 replicas of tablet 54afdb181f174a8ba7ef956a7dd13125
I20260807 10:45:15.718885 28588 tablet_service.cc:1514] Processing DeleteTablet for tablet 54afdb181f174a8ba7ef956a7dd13125 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:45:15 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:32830
I20260807 10:45:15.718915 28813 tablet_service.cc:1514] Processing DeleteTablet for tablet 54afdb181f174a8ba7ef956a7dd13125 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:45:15 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:52906
I20260807 10:45:15.719741 29006 tablet_service.cc:1514] Processing DeleteTablet for tablet 54afdb181f174a8ba7ef956a7dd13125 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:45:15 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:36972
I20260807 10:45:15.719928 29176 tablet_replica.cc:330] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: stopping tablet replica
I20260807 10:45:15.720417 29176 raft_consensus.cc:2229] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:45:15.720793 29178 tablet_replica.cc:330] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: stopping tablet replica
I20260807 10:45:15.721263 29176 raft_consensus.cc:2258] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:45:15.721329 29178 raft_consensus.cc:2229] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:45:15.722046 29178 raft_consensus.cc:2258] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:45:15.722887 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 28483
I20260807 10:45:15.724092 29176 ts_tablet_manager.cc:1905] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:45:15.724504 29178 ts_tablet_manager.cc:1905] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:45:15.732197 29176 ts_tablet_manager.cc:1918] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:45:15.732195 29178 ts_tablet_manager.cc:1918] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:45:15.732445 29176 log.cc:1196] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/54afdb181f174a8ba7ef956a7dd13125
I20260807 10:45:15.732623 29178 log.cc:1196] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/54afdb181f174a8ba7ef956a7dd13125
I20260807 10:45:15.733074 29176 ts_tablet_manager.cc:1939] T 54afdb181f174a8ba7ef956a7dd13125 P f800f422551a4eaf96ffcfdd96ab8ba9: Deleting consensus metadata
I20260807 10:45:15.733300 29178 ts_tablet_manager.cc:1939] T 54afdb181f174a8ba7ef956a7dd13125 P a67469c446474b8a9245243b8ba112bb: Deleting consensus metadata
I20260807 10:45:15.735364 28342 catalog_manager.cc:4841] TS f800f422551a4eaf96ffcfdd96ab8ba9 (127.11.46.129:36881): tablet 54afdb181f174a8ba7ef956a7dd13125 (table test-table [id=788b0ebe663f417197c89ae059691c8c]) successfully deleted
I20260807 10:45:15.735706 28342 catalog_manager.cc:4841] TS a67469c446474b8a9245243b8ba112bb (127.11.46.131:40813): tablet 54afdb181f174a8ba7ef956a7dd13125 (table test-table [id=788b0ebe663f417197c89ae059691c8c]) successfully deleted
I20260807 10:45:15.737174 29177 tablet_replica.cc:330] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: stopping tablet replica
I20260807 10:45:15.737772 29177 raft_consensus.cc:2229] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:45:15.738385 29177 raft_consensus.cc:2258] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:45:15.740984 29177 ts_tablet_manager.cc:1905] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 10:45:15 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:45:15.748767 29177 ts_tablet_manager.cc:1918] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:45:15.749001 29177 log.cc:1196] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/54afdb181f174a8ba7ef956a7dd13125
I20260807 10:45:15.749619 29177 ts_tablet_manager.cc:1939] T 54afdb181f174a8ba7ef956a7dd13125 P 25bceb7630db42958dcc07b49eb4d2aa: Deleting consensus metadata
I20260807 10:45:15.752044 28342 catalog_manager.cc:4841] TS 25bceb7630db42958dcc07b49eb4d2aa (127.11.46.130:43139): tablet 54afdb181f174a8ba7ef956a7dd13125 (table test-table [id=788b0ebe663f417197c89ae059691c8c]) successfully deleted
I20260807 10:45:15.758379 29138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.724766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32852 (local address 127.11.46.129:36881)
0807 10:45:15.724973 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:15.724979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:15.736462 (+ 11483us) server_negotiation.cc:407] Connection header received
0807 10:45:15.736655 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:15.736661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:15.736788 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:15.736894 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:45:15.738864 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.740131 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.742195 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.742895 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.743009 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.748959 (+ 5950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:45:15.748990 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:45:15.749015 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:45:15.749084 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:45:15.754203 (+ 5119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:15.755375 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:15.755387 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:15.755391 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:15.755644 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:15.756104 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:15.756110 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:15.756114 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:15.756677 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:45:15.757072 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:15.757783 (+ 711us) server_negotiation.cc:299] Negotiation successful
0807 10:45:15.758042 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:45:15.760118 28677 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:45:15.866464 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 28483
I20260807 10:45:15.899948 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 28691
Aug 07 10:45:15 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:45:15.916590 29129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:15.900826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52920 (local address 127.11.46.130:43139)
0807 10:45:15.901027 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:15.901032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:15.901054 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:45:15.901117 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:15.901121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:15.901188 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:15.901272 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:45:15.902619 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.903417 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.904891 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:15.905323 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:15.905430 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:15.910121 (+ 4691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:45:15.910142 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:45:15.910164 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:45:15.910209 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:45:15.913376 (+ 3167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:15.914320 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:15.914328 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:15.914330 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:15.914503 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:15.914994 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:15.914998 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:15.915000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:15.915479 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:45:15.915779 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:15.916016 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 10:45:15.916219 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:45:15.917461 28893 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:45:16.011871 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 28691
I20260807 10:45:16.043018 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 28912
Aug 07 10:45:16 dist-test-slave-42z9 krb5kdc[27662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:45:16.059245 29134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:45:16.043853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36980 (local address 127.11.46.131:40813)
0807 10:45:16.044036 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 10:45:16.044040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:45:16.044060 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:45:16.044162 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:45:16.044167 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:45:16.044231 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:45:16.044330 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:45:16.045814 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:16.046578 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:16.047996 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:45:16.048377 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:45:16.048485 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:45:16.053256 (+ 4771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:45:16.053278 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:45:16.053299 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:45:16.053345 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:45:16.056336 (+ 2991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:16.057194 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:16.057204 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:16.057207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:16.057382 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:45:16.057786 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:45:16.057790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:45:16.057792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:45:16.058225 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:45:16.058477 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0807 10:45:16.058704 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 10:45:16.058902 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 10:45:16.059939 29099 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:45:16.159487 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 28912
I20260807 10:45:16.190984 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 28318
I20260807 10:45:16.192281 28406 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:45:16.311424 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 28318
I20260807 10:45:16.348409 11450 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 10:45:16.694897 11450 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 10:45:16.695166 11450 mini_ranger.cc:66] Stopping Ranger...
I20260807 10:45:17.051074 11450 mini_ranger.cc:68] Stopped Ranger
2026-08-07 10:45:17.051 UTC [27706] LOG: received smart shutdown request
2026-08-07 10:45:17.055 UTC [27706] LOG: background worker "logical replication launcher" (PID 27716) exited with exit code 1
2026-08-07 10:45:17.055 UTC [27711] LOG: shutting down
2026-08-07 10:45:17.203 UTC [27706] LOG: database system is shut down
2026-08-07T10:45:17Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (52968 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:45:17 dist-test-slave-42z9 krb5kdc[29197](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:45:17 dist-test-slave-42z9 krb5kdc[29197](info): set up 2 sockets
Aug 07 10:45:17 dist-test-slave-42z9 krb5kdc[29197](info): commencing operation
krb5kdc: starting...
W20260807 10:45:18.577028 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.000s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:45:18 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:45:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:45:18Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.46.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.46.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/rangeradmin_127.11.46.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/rangeradmin_127.11.46.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.46.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.46.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/rangerlookup_127.11.46.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/rangerlookup_127.11.46.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.46.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.46.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/HTTP_127.11.46.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/HTTP_127.11.46.148@KRBTEST.COM.keytab.
I20260807 10:45:19.070295 11450 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasktN6EqJ/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/postgres -l logfile start
2026-08-07 10:45:21.522 UTC [29239] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 10:45:21.522 UTC [29239] LOG: listening on IPv4 address "127.11.46.148", port 58665
2026-08-07 10:45:21.525 UTC [29239] LOG: listening on Unix socket "/tmp/.s.PGSQL.58665"
2026-08-07 10:45:21.546 UTC [29242] LOG: database system was shut down at 2026-08-07 10:45:20 UTC
2026-08-07 10:45:21.551 UTC [29239] LOG: database system is ready to accept connections
I20260807 10:45:22.640997 11450 mini_postgres.cc:96] Postgres bound to 58665
2026-08-07 10:45:22.669 UTC [29257] FATAL: database "slave" does not exist
127.11.46.148:58665 - accepting connections
I20260807 10:45:22.670156 11450 mini_ranger.cc:161] Starting Ranger...
I20260807 10:45:22.709255 11450 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 10:45:23.175442 11450 mini_ranger.cc:87] Created ranger Postgres database
I20260807 10:45:23.175554 11450 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-admin
2026-08-07 10:45:23,488 [I] DB FLAVOR :POSTGRES
2026-08-07 10:45:23,488 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 10:45:23,488 [I] Checking connection..
2026-08-07 10:45:23,489 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 10:45:23,775 [I] Checking connection passed.
2026-08-07 10:45:23,775 [I] --------- Verifying version history table ---------
2026-08-07 10:45:23,775 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:45:24,065 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 10:45:24,066 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:45:24,327 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 10:45:24,327 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 10:45:24,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 10:45:24.599 UTC [29348] WARNING: there is no transaction in progress
2026-08-07 10:45:24,608 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 10:45:24,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 10:45:24,901 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 10:45:24,901 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 10:45:24,901 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 10:45:25,189 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 10:45:25,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-42z9.c.gcp-upstream.internal','N') ;"
2026-08-07 10:45:25,725 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 10:45:25,999 [I] Table x_portal_user does not exist in database ranger
2026-08-07 10:45:26,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 10:45:26,280 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 10:45:26,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 10:45:26,553 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 10:45:26,830 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 10:45:26,831 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 10:45:27.856 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:27.872 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:27.889 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:27.904 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:27.920 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:27.938 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:27.998 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:28.005 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:28.019 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:28.030 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:28.042 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:28.055 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:28.065 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:28.071 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:28.078 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:28.085 UTC [29493] WARNING: there is no transaction in progress
2026-08-07 10:45:28,717 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 10:45:28,718 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 10:45:28,996 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 10:45:28,997 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 10:45:29,274 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 10:45:29,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 10:45:29,547 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 10:45:29,547 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 10:45:29,836 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 10:45:30,117 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-42z9.c.gcp-upstream.internal';"
2026-08-07 10:45:30,388 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 10:45:30,388 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 10:45:30,663 [I] DB_PATCHES have already been applied
I20260807 10:45:30.670326 11450 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-admin:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasktN6EqJ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 10:45:30.670439 11450 mini_ranger.cc:193] Using host: 127.11.46.148
I20260807 10:45:30.696228 11450 mini_ranger.cc:227] Ranger admin URL: http://127.11.46.148:45525
Aug 07, 2026 10:45:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:45:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:45:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 10:45:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 10:45:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 10:45:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 10:45:31 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 10:45:31.987532 11450 mini_ranger.cc:160] Time spent starting Ranger: real 9.317s user 0.005s sys 0.083s
Aug 07, 2026 10:45:53 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 10:45:53 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 10:45:53 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 10:45:54 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 10:45:55 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 10:45:55.732429 11450 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.46.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.46.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/rangerkms_127.11.46.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.46.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/rangerkms_127.11.46.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.46.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.46.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.46.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/HTTP_127.11.46.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.46.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/HTTP_127.11.46.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 10:45:55 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099555, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 10:45:55.994906 11450 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 10:45:56.028663 11450 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 10:45:56.882228 11450 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 10:45:56.882375 11450 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-kms
I20260807 10:45:56.882421 11450 mini_ranger_kms.cc:227] Using postgres at 127.11.46.148:58665
2026-08-07 10:45:57,262 [I] DB FLAVOR :POSTGRES
2026-08-07 10:45:57,262 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 10:45:57,262 [I] Checking connection
2026-08-07 10:45:57,262 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 10:45:57,539 [I] connection success
2026-08-07 10:45:57,539 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 10:45:57,539 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 10:45:57,539 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 10:45:57,820 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 10:45:57,820 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 10:45:57,820 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 10:45:57,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.46.148:58665/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 10:45:58,123 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 10:45:58.662745 11450 mini_ranger_kms.cc:310] Created kms service
I20260807 10:45:58.855702 11450 mini_ranger_kms.cc:326] Created kudu user
I20260807 10:45:58.905534 11450 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 10:45:58 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099555, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:45:59.388446 11450 mini_ranger_kms.cc:384] Added ranger policy
I20260807 10:45:59.388805 11450 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-kms:/tmp/dist-test-tasktN6EqJ/build/asan/bin/postgresql.jar:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasktN6EqJ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 10:45:59.388859 11450 mini_ranger_kms.cc:240] Using host: 127.11.46.148
I20260807 10:45:59.418197 11450 mini_ranger_kms.cc:276] Ranger KMS PID: 29778
I20260807 10:45:59.418574 11450 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.46.148:56759
Aug 07, 2026 10:46:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 10:46:00 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 10:46:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 10:46:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 10:46:01 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 10:46:01 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 10:46:01 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786099561, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.46.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:02.032836 11450 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.038s user 0.092s sys 0.351s
I20260807 10:46:02.033093 11450 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 10:46:02.033270 11450 mini_ranger_kms.cc:401] 127.11.46.148:56759/kms/v1/keys
Aug 07 10:46:02 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099561, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.46.148@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
Aug 07 10:46:02 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099561, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.46.148@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
Aug 07 10:46:05 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:46:05.303507 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36063
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:36063
--ranger_config_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:56759/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:05.690217 29847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:05.690588 29847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:05.690692 29847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:05.698390 29847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:46:05.698541 29847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:05.698597 29847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:05.698657 29847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:46:05.698705 29847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:46:05.709875 29847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.46.148:56759/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:36063
--ranger_config_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:05.711330 29847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:05.712824 29847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:05.726141 29856 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:05.726168 29862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:05.726109 29859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:05.726866 29847 server_base.cc:1034] running on GCE node
I20260807 10:46:05.727785 29847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:05.729519 29847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:05.730751 29847 hybrid_clock.cc:648] HybridClock initialized: now 1786099565730705 us; error 36 us; skew 500 ppm
I20260807 10:46:05.731171 29847 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:05 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099565, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:05.738725 29847 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:46:05.740537 29847 webserver.cc:460] Webserver started at http://127.11.46.190:38727/ using document root <none> and password file <none>
I20260807 10:46:05.741255 29847 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:05.741369 29847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:05.741747 29847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:46:05 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099565, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:46:05.816541 29847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "7f4abf106282430c9279c72a26c56c01"
format_stamp: "Formatted at 2026-08-07 10:46:05 on dist-test-slave-42z9"
server_key: "61ae31b0359e9fbe39502ff5b819c2be"
server_key_iv: "929ef278fb0e984574c306addac4fc3e"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:05.817636 29847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "7f4abf106282430c9279c72a26c56c01"
format_stamp: "Formatted at 2026-08-07 10:46:05 on dist-test-slave-42z9"
server_key: "61ae31b0359e9fbe39502ff5b819c2be"
server_key_iv: "929ef278fb0e984574c306addac4fc3e"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:05.824396 29847 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:46:05.846215 29871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:05.848275 29847 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:46:05.848593 29847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "7f4abf106282430c9279c72a26c56c01"
format_stamp: "Formatted at 2026-08-07 10:46:05 on dist-test-slave-42z9"
server_key: "61ae31b0359e9fbe39502ff5b819c2be"
server_key_iv: "929ef278fb0e984574c306addac4fc3e"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:05.848939 29847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:05.877381 29847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:05.883162 29847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:05.883657 29847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:05.910323 29847 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:36063
I20260807 10:46:05.910367 29938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:36063 every 8 connection(s)
I20260807 10:46:05.912123 29847 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:46:05.914410 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 29847
I20260807 10:46:05.914680 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:46:05.915627 11450 external_mini_cluster.cc:1428] Setting key 4b841b9a1fb4b594137a05df9233e894
I20260807 10:46:05.917963 29939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:46:05 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:05.936745 29939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: Bootstrap starting.
I20260807 10:46:05.941470 29939 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:05.942786 29939 log.cc:824] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:05.946909 29939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: No bootstrap required, opened a new log
I20260807 10:46:05.947331 29945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:05.918057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.11.46.190:36063)
0807 10:46:05.919052 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:05.919070 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:05.919129 (+ 59us) server_negotiation.cc:407] Connection header received
0807 10:46:05.921617 (+ 2488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:05.921658 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:05.922345 (+ 687us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:05.922887 (+ 542us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:05.924346 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:05.926593 (+ 2247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:05.928690 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:05.930110 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:05.930365 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:05.938250 (+ 7885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:05.938260 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:05.938278 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:05.938345 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:05.941998 (+ 3653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:05.942886 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:05.942894 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:05.942903 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:05.943116 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:05.943627 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:05.943631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:05.943634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:05.944407 (+ 773us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:05.944757 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:05.945202 (+ 445us) server_negotiation.cc:299] Negotiation successful
0807 10:46:05.945766 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":431,"threads_started":1}
I20260807 10:46:05.956257 29939 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } }
I20260807 10:46:05.956781 29939 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:05.956915 29939 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4abf106282430c9279c72a26c56c01, State: Initialized, Role: FOLLOWER
I20260807 10:46:05.957713 29939 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } }
I20260807 10:46:05.958003 29939 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:46:05.958163 29939 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:46:05.958350 29939 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:05.960844 29939 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } }
I20260807 10:46:05.961581 29939 leader_election.cc:302] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f4abf106282430c9279c72a26c56c01; no voters:
I20260807 10:46:05.962323 29939 leader_election.cc:288] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:46:05.962502 29949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:46:05.963618 29949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4abf106282430c9279c72a26c56c01, State: Running, Role: LEADER
I20260807 10:46:05.964232 29949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } }
I20260807 10:46:05.964723 29939 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:46:05.967535 29952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f4abf106282430c9279c72a26c56c01. Latest consensus state: current_term: 1 leader_uuid: "7f4abf106282430c9279c72a26c56c01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } } }
I20260807 10:46:05.967590 29950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f4abf106282430c9279c72a26c56c01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } } }
I20260807 10:46:05.968022 29952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:05.968022 29950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:05.973861 29963 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:46:05.974567 29939 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 10:46:05.994207 29963 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:46:06.011885 29963 catalog_manager.cc:1347] Generated new cluster ID: a94992fdd03f427db31eff41924b9a8a
I20260807 10:46:06.012038 29963 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:46:06.039248 29963 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:46:06.041828 29963 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:46:06.052722 29963 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: Generated new TSK 0
I20260807 10:46:06.054270 29963 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:46:06.909085 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:56759/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36063
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:46:07 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786099567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 10:46:07.449255 30012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:07.449743 30012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:07.449905 30012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:07.459470 30012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:07.459625 30012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:07.459790 30012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:46:07.474467 30012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.46.148:56759/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:07.476518 30012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:07.478519 30012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:07.496389 30030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:07.497052 30034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:07.496358 30031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:07.497259 30012 server_base.cc:1034] running on GCE node
I20260807 10:46:07.498099 30012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:07.499400 30012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:07.500723 30012 hybrid_clock.cc:648] HybridClock initialized: now 1786099567500630 us; error 97 us; skew 500 ppm
I20260807 10:46:07.501173 30012 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:07 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:07.506223 30012 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:46:07.522919 30012 webserver.cc:460] Webserver started at http://127.11.46.129:38411/ using document root <none> and password file <none>
I20260807 10:46:07.524323 30012 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:07.524607 30012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:07.525144 30012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:46:07 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:46:07.549857 30012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "a6777e5dd1454d5c92238301d99c5bd2"
format_stamp: "Formatted at 2026-08-07 10:46:07 on dist-test-slave-42z9"
server_key: "f4b3f5d235977f7fb0499ad0604c450f"
server_key_iv: "4fd6467f41100e61561f5a7dd7c1c931"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:07.551321 30012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "a6777e5dd1454d5c92238301d99c5bd2"
format_stamp: "Formatted at 2026-08-07 10:46:07 on dist-test-slave-42z9"
server_key: "f4b3f5d235977f7fb0499ad0604c450f"
server_key_iv: "4fd6467f41100e61561f5a7dd7c1c931"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:07.562427 30012 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.009s sys 0.000s
I20260807 10:46:07.606252 30043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:07.608206 30012 fs_manager.cc:725] Time spent opening block manager: real 0.023s user 0.008s sys 0.011s
I20260807 10:46:07.608465 30012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "a6777e5dd1454d5c92238301d99c5bd2"
format_stamp: "Formatted at 2026-08-07 10:46:07 on dist-test-slave-42z9"
server_key: "f4b3f5d235977f7fb0499ad0604c450f"
server_key_iv: "4fd6467f41100e61561f5a7dd7c1c931"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:07.608726 30012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:07.654598 30012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:07.660461 30012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:07.660883 30012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:07.662312 30012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
Aug 07 10:46:07 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:46:07.694746 30012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:07.694931 30012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 10:46:07.695097 30012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:07.695168 30012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:07.887951 30012 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:45409
I20260807 10:46:07.888463 30211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:45409 every 8 connection(s)
I20260807 10:46:07.889923 30012 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:46:07.895540 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 30012
I20260807 10:46:07.895813 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:46:07.896752 11450 external_mini_cluster.cc:1428] Setting key de99dff81fbd55559a63b0fa4a666f25
Aug 07 10:46:07 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:07.948173 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:07.898279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:35161 (local address 127.11.46.190:36063)
0807 10:46:07.919946 (+ 21667us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:07.919954 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:07.921523 (+ 1569us) server_negotiation.cc:407] Connection header received
0807 10:46:07.926135 (+ 4612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:07.926143 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:07.926260 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:07.926357 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:07.929042 (+ 2685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:07.930291 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:07.933065 (+ 2774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:07.933773 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:07.933891 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:07.939125 (+ 5234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:07.939133 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:07.939138 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:07.939191 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:07.943631 (+ 4440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:07.944848 (+ 1217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:07.944855 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:07.944858 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:07.945048 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:07.945784 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:07.945790 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:07.945794 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:07.946177 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:07.946304 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:07.947454 (+ 1150us) server_negotiation.cc:299] Negotiation successful
0807 10:46:07.947741 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21491,"thread_start_us":21686,"threads_started":1}
I20260807 10:46:07.951114 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:07.897541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36063 (local address 127.11.46.129:35161)
0807 10:46:07.920848 (+ 23307us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:07.920921 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:07.925680 (+ 4759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:07.927017 (+ 1337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:07.927031 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:07.927810 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:07.928774 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:07.928806 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:07.930592 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:07.930598 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:07.932826 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:07.932861 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:07.934330 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:07.934340 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:07.934698 (+ 358us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:07.935584 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:07.935630 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:07.938740 (+ 3110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:07.943945 (+ 5205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:07.943956 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:07.943978 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:07.944667 (+ 689us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:07.945231 (+ 564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:07.945236 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:07.945239 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:07.945627 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:07.946430 (+ 803us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:07.946439 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:07.946955 (+ 516us) client_negotiation.cc:769] Sending connection context
0807 10:46:07.948830 (+ 1875us) client_negotiation.cc:240] Negotiation successful
0807 10:46:07.949554 (+ 724us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22854,"thread_start_us":25477,"threads_started":1}
I20260807 10:46:07.953826 30214 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36063
I20260807 10:46:07.954301 30214 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:07.955372 30214 heartbeater.cc:511] Master 127.11.46.190:36063 requested a full tablet report, sending...
I20260807 10:46:07.958742 29898 ts_manager.cc:194] Registered new tserver with Master: a6777e5dd1454d5c92238301d99c5bd2 (127.11.46.129:45409)
I20260807 10:46:07.961084 29898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:35161
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
W20260807 10:46:08.011909 11450 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.11.46.130: real 0.111s user 0.002s sys 0.032s
I20260807 10:46:08.012934 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:56759/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36063
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:46:08 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
W20260807 10:46:08.520539 30226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:08.520886 30226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:08.521024 30226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:08.528710 30226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:08.528884 30226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:08.529089 30226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:46:08.539971 30226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.46.148:56759/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:08.541508 30226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:08.542991 30226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:08.558125 30251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:08.558169 30249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:08.558249 30248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:08.559461 30226 server_base.cc:1034] running on GCE node
I20260807 10:46:08.560254 30226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:08.561466 30226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:08.562732 30226 hybrid_clock.cc:648] HybridClock initialized: now 1786099568562662 us; error 59 us; skew 500 ppm
I20260807 10:46:08.563113 30226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:08 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099568, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:08.566741 30226 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:46:08.568535 30226 webserver.cc:460] Webserver started at http://127.11.46.130:33443/ using document root <none> and password file <none>
I20260807 10:46:08.569336 30226 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:08.569499 30226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:08.569876 30226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:46:08 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099568, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:46:08.585736 30226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "67af5e457eb34c7993c93d0096c47001"
format_stamp: "Formatted at 2026-08-07 10:46:08 on dist-test-slave-42z9"
server_key: "5235a23c022380e20431578c903d7b72"
server_key_iv: "9a7075cd37f8fb0d6ac7eaf3370d387c"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:08.586686 30226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "67af5e457eb34c7993c93d0096c47001"
format_stamp: "Formatted at 2026-08-07 10:46:08 on dist-test-slave-42z9"
server_key: "5235a23c022380e20431578c903d7b72"
server_key_iv: "9a7075cd37f8fb0d6ac7eaf3370d387c"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:08.593066 30226 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:46:08.611356 30260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:08.613524 30226 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:46:08.613799 30226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "67af5e457eb34c7993c93d0096c47001"
format_stamp: "Formatted at 2026-08-07 10:46:08 on dist-test-slave-42z9"
server_key: "5235a23c022380e20431578c903d7b72"
server_key_iv: "9a7075cd37f8fb0d6ac7eaf3370d387c"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:08.614167 30226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:08.644879 30226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:08.650564 30226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:08.650960 30226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:08.652354 30226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:08.656194 30226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:08.656312 30226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:08.656456 30226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:08.656519 30226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:08.711934 30226 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:34037
I20260807 10:46:08.711946 30434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:34037 every 8 connection(s)
I20260807 10:46:08.713902 30226 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:46:08.721212 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 30226
I20260807 10:46:08.721410 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:46:08.722041 11450 external_mini_cluster.cc:1428] Setting key 781f88162809aac82e1b7da6ba175158
Aug 07 10:46:08 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099568, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:08.740847 30437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:08.717232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:43413 (local address 127.11.46.190:36063)
0807 10:46:08.717861 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:08.717866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:08.719169 (+ 1303us) server_negotiation.cc:407] Connection header received
0807 10:46:08.721309 (+ 2140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:08.721316 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:08.721426 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:08.721572 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:08.723475 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:08.724765 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:08.727332 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:08.728002 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:08.728151 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:08.732965 (+ 4814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:08.732973 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:08.732977 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:08.733035 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:08.736513 (+ 3478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:08.737784 (+ 1271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:08.737790 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:08.737793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:08.737969 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:08.738599 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:08.738603 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:08.738606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:08.738996 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:08.739147 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:08.740264 (+ 1117us) server_negotiation.cc:299] Negotiation successful
0807 10:46:08.740540 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":503,"thread_start_us":371,"threads_started":1}
I20260807 10:46:08.742460 30438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:08.718102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36063 (local address 127.11.46.130:43413)
0807 10:46:08.718986 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:08.719029 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:08.720955 (+ 1926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:08.721936 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:08.721946 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:08.722473 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:08.723256 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:08.723280 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:08.724996 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:08.725002 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:08.727103 (+ 2101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:08.727138 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:08.728301 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:08.728310 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:08.728674 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:08.729577 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:08.729609 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:08.732608 (+ 2999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:08.736762 (+ 4154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:08.736775 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:08.736800 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:08.737610 (+ 810us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:08.738112 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:08.738118 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:08.738122 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:08.738459 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:08.739153 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:08.739162 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:08.739742 (+ 580us) client_negotiation.cc:769] Sending connection context
0807 10:46:08.740116 (+ 374us) client_negotiation.cc:240] Negotiation successful
0807 10:46:08.740768 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":366,"threads_started":1}
I20260807 10:46:08.744413 30435 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36063
I20260807 10:46:08.744732 30435 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:08.745505 30435 heartbeater.cc:511] Master 127.11.46.190:36063 requested a full tablet report, sending...
I20260807 10:46:08.747349 29898 ts_manager.cc:194] Registered new tserver with Master: 67af5e457eb34c7993c93d0096c47001 (127.11.46.130:34037)
I20260807 10:46:08.748546 29898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:43413
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:46:08.804642 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:56759/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36063
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:46:08.965569 30214 heartbeater.cc:503] Master 127.11.46.190:36063 was elected leader, sending a full tablet report...
W20260807 10:46:09.275689 30445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:09.276038 30445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:09.276171 30445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:09.284343 30445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:09.284497 30445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:09.284650 30445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:46:09.297030 30445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.46.148:56759/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:36063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:09.299064 30445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:09.301015 30445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:09.316871 30450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:09.316816 30451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:09.316973 30454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:09.317898 30445 server_base.cc:1034] running on GCE node
I20260807 10:46:09.318571 30445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:09.319665 30445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:09.320905 30445 hybrid_clock.cc:648] HybridClock initialized: now 1786099569320827 us; error 61 us; skew 500 ppm
I20260807 10:46:09.321272 30445 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:09 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099569, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:09.324975 30445 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:46:09.326771 30445 webserver.cc:460] Webserver started at http://127.11.46.131:46047/ using document root <none> and password file <none>
I20260807 10:46:09.327636 30445 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:09.327772 30445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:09.328174 30445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 10:46:09 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099569, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:46:09.349656 30445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "a8e230bb28534bd69aedc62216e45d32"
format_stamp: "Formatted at 2026-08-07 10:46:09 on dist-test-slave-42z9"
server_key: "b26fbd755c8966e469b2d3b549ff389a"
server_key_iv: "ea422cd0fa4675d2c3442ae2c71ee2d0"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:09.350965 30445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "a8e230bb28534bd69aedc62216e45d32"
format_stamp: "Formatted at 2026-08-07 10:46:09 on dist-test-slave-42z9"
server_key: "b26fbd755c8966e469b2d3b549ff389a"
server_key_iv: "ea422cd0fa4675d2c3442ae2c71ee2d0"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:09.359748 30445 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.003s sys 0.006s
I20260807 10:46:09.381395 30462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:09.383435 30445 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260807 10:46:09.383661 30445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "a8e230bb28534bd69aedc62216e45d32"
format_stamp: "Formatted at 2026-08-07 10:46:09 on dist-test-slave-42z9"
server_key: "b26fbd755c8966e469b2d3b549ff389a"
server_key_iv: "ea422cd0fa4675d2c3442ae2c71ee2d0"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:09.383932 30445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:09.405761 30445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:09.410182 30445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:09.410507 30445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:09.411559 30445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:09.413147 30445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:09.413235 30445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:09.413360 30445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:09.413416 30445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:09.446868 30445 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:39625
I20260807 10:46:09.446911 30624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:39625 every 8 connection(s)
I20260807 10:46:09.448449 30445 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:46:09.450304 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 30445
I20260807 10:46:09.450521 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:46:09.451138 11450 external_mini_cluster.cc:1428] Setting key 9845975f76a34cce4398f99f63d512b0
Aug 07 10:46:09 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099569, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:09.471575 30627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:09.451687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:53067 (local address 127.11.46.190:36063)
0807 10:46:09.452274 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:09.452280 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:09.453596 (+ 1316us) server_negotiation.cc:407] Connection header received
0807 10:46:09.455796 (+ 2200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:09.455801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:09.455909 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:09.456007 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:09.457775 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:09.458534 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:09.460239 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:09.460705 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:09.460810 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:09.464732 (+ 3922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:09.464739 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:09.464743 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:09.464787 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:09.468294 (+ 3507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:09.469188 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:09.469192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:09.469195 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:09.469334 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:09.469798 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:09.469802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:09.469805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:09.470143 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:09.470279 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:09.471057 (+ 778us) server_negotiation.cc:299] Negotiation successful
0807 10:46:09.471278 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":282,"threads_started":1}
I20260807 10:46:09.472712 30628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:09.452395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36063 (local address 127.11.46.131:53067)
0807 10:46:09.453395 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:09.453484 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:09.455482 (+ 1998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:09.456253 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:09.456262 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:09.456825 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:09.457584 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:09.457610 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:09.458682 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:09.458686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:09.460081 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:09.460106 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:09.460928 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:09.460934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:09.461182 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:09.461934 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:09.461963 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:09.464379 (+ 2416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:09.468494 (+ 4115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:09.468505 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:09.468524 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:09.469073 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:09.469418 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:09.469421 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:09.469423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:09.469694 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:09.470264 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:09.470272 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:09.470676 (+ 404us) client_negotiation.cc:769] Sending connection context
0807 10:46:09.470940 (+ 264us) client_negotiation.cc:240] Negotiation successful
0807 10:46:09.471463 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":423,"threads_started":1}
I20260807 10:46:09.474428 30625 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36063
I20260807 10:46:09.474807 30625 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:09.475634 30625 heartbeater.cc:511] Master 127.11.46.190:36063 requested a full tablet report, sending...
I20260807 10:46:09.477382 29898 ts_manager.cc:194] Registered new tserver with Master: a8e230bb28534bd69aedc62216e45d32 (127.11.46.131:39625)
I20260807 10:46:09.478470 29898 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:53067
I20260807 10:46:09.480629 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:46:09.482439 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 30012
Aug 07 10:46:09 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:46:09.501355 30631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:09.483552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45628 (local address 127.11.46.129:45409)
0807 10:46:09.484232 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:09.484239 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:09.484266 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:46:09.484328 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:09.484334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:09.484556 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:09.484694 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:09.486449 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:09.487528 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:09.489011 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:09.489767 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:09.489883 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:09.494920 (+ 5037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:09.494950 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:09.494973 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:09.495038 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:09.498213 (+ 3175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:09.499132 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:09.499141 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:09.499144 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:09.499373 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:09.499746 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:09.499749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:09.499751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:09.500159 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:09.500451 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:09.500703 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 10:46:09.500956 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":311,"threads_started":1}
I20260807 10:46:09.502882 30205 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:09.589958 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 30012
I20260807 10:46:09.617254 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 30226
Aug 07 10:46:09 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:46:09.641260 30634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:09.618307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41086 (local address 127.11.46.130:34037)
0807 10:46:09.618875 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:09.618884 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:09.618914 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:46:09.618980 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:09.618987 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:09.619244 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:09.619443 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:09.621009 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:09.622835 (+ 1826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:09.624589 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:09.625226 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:09.625354 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:09.635143 (+ 9789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:09.635165 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:09.635186 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:09.635237 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:09.638337 (+ 3100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:09.639236 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:09.639245 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:09.639248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:09.639435 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:09.639766 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:09.639769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:09.639772 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:09.640175 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:09.640460 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:09.640685 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 10:46:09.640929 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":269,"threads_started":1}
I20260807 10:46:09.642777 30428 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:09.729272 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 30226
I20260807 10:46:09.753566 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 30445
Aug 07 10:46:09 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:46:09.774840 30637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:09.754727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52902 (local address 127.11.46.131:39625)
0807 10:46:09.755504 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:09.755513 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:09.755545 (+ 32us) server_negotiation.cc:407] Connection header received
0807 10:46:09.755641 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:09.755649 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:09.755910 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:09.756070 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:09.757537 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:09.758645 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:09.759997 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:09.760632 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:09.760741 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:09.768625 (+ 7884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:09.768646 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:09.768668 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:09.768721 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:09.771817 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:09.772684 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:09.772693 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:09.772696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:09.772850 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:09.773179 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:09.773182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:09.773184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:09.773622 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:09.773918 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:09.774220 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 10:46:09.774452 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":372,"threads_started":1}
I20260807 10:46:09.776165 30617 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:09.863466 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 30445
I20260807 10:46:09.893353 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 29847
I20260807 10:46:09.894869 29934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:10.027519 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 29847
I20260807 10:46:10.067281 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36063
--webserver_interface=127.11.46.190
--webserver_port=38727
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:36063
--ranger_config_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:56759/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.46.148:56759/kms with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:10.454839 30641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:10.455240 30641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:10.455374 30641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:10.463327 30641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:46:10.463495 30641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:10.463586 30641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:10.463665 30641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:46:10.463735 30641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:46:10.474833 30641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.46.148:56759/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:36063
--ranger_config_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=38727
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:10.476388 30641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:10.478036 30641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:10.492193 30647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:10.492245 30649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:10.492271 30646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:10.493151 30641 server_base.cc:1034] running on GCE node
I20260807 10:46:10.494118 30641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:10.496076 30641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:10.497500 30641 hybrid_clock.cc:648] HybridClock initialized: now 1786099570497330 us; error 151 us; skew 500 ppm
I20260807 10:46:10.497926 30641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:10 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099570, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:10.501500 30641 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:46:10.503290 30641 webserver.cc:460] Webserver started at http://127.11.46.190:38727/ using document root <none> and password file <none>
I20260807 10:46:10.504047 30641 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:10.504189 30641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 10:46:10 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099570, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:46:10.583513 30641 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:46:10.587347 30660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:10.589053 30641 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:46:10.589300 30641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "7f4abf106282430c9279c72a26c56c01"
format_stamp: "Formatted at 2026-08-07 10:46:05 on dist-test-slave-42z9"
server_key: "61ae31b0359e9fbe39502ff5b819c2be"
server_key_iv: "929ef278fb0e984574c306addac4fc3e"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:10.590528 30641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:10.621964 30641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:10.627034 30641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:10.627414 30641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:10.647610 30641 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:36063
I20260807 10:46:10.647629 30738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:36063 every 8 connection(s)
I20260807 10:46:10.649338 30641 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:46:10.655571 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 30641
I20260807 10:46:10.656687 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:56759/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:45409
--local_ip_for_outbound_sockets=127.11.46.129
--tserver_master_addrs=127.11.46.190:36063
--webserver_port=38411
--webserver_interface=127.11.46.129
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.46.148:56759/kms with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:46:10.658202 30739 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:46:10.663100 30739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: Bootstrap starting.
I20260807 10:46:10.686122 30739 log.cc:824] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:10.697794 30739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:46:10.698441 30739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: Bootstrap complete.
I20260807 10:46:10.708434 30739 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } }
I20260807 10:46:10.709401 30739 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4abf106282430c9279c72a26c56c01, State: Initialized, Role: FOLLOWER
I20260807 10:46:10.710166 30739 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } }
I20260807 10:46:10.710408 30739 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:46:10.710536 30739 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:46:10.710721 30739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:46:10.715215 30739 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } }
I20260807 10:46:10.715862 30739 leader_election.cc:302] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f4abf106282430c9279c72a26c56c01; no voters:
I20260807 10:46:10.716558 30739 leader_election.cc:288] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 10:46:10.716740 30746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 10:46:10.717865 30746 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [term 2 LEADER]: Becoming Leader. State: Replica: 7f4abf106282430c9279c72a26c56c01, State: Running, Role: LEADER
I20260807 10:46:10.718626 30746 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } }
I20260807 10:46:10.719115 30739 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:46:10.721778 30748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f4abf106282430c9279c72a26c56c01. Latest consensus state: current_term: 2 leader_uuid: "7f4abf106282430c9279c72a26c56c01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } } }
I20260807 10:46:10.722362 30748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:10.722920 30747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7f4abf106282430c9279c72a26c56c01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4abf106282430c9279c72a26c56c01" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36063 } } }
I20260807 10:46:10.723286 30747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01 [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:10.725809 30758 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:46:10.732800 30758 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:46:10.734596 30758 catalog_manager.cc:1259] Loaded cluster ID: a94992fdd03f427db31eff41924b9a8a
I20260807 10:46:10.734822 30758 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:46:10.739719 30758 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:46:10.741739 30758 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: Loaded TSK: 0
I20260807 10:46:10.743698 30758 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:46:10.750042 30739 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260807 10:46:11.150089 30742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:11.150653 30742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:11.150863 30742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:11.163573 30742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:11.163851 30742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:11.164126 30742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:46:11.181417 30742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.46.148:56759/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:45409
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=38411
--tserver_master_addrs=127.11.46.190:36063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:11.184074 30742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:11.186421 30742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:11.219609 30800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:11.227837 30802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:11.232182 30742 server_base.cc:1034] running on GCE node
W20260807 10:46:11.233044 30804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:11.234237 30742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:11.236207 30742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:11.239074 30742 hybrid_clock.cc:648] HybridClock initialized: now 1786099571238975 us; error 102 us; skew 500 ppm
I20260807 10:46:11.239622 30742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:11 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099571, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:11.248242 30742 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:46:11.263767 30742 webserver.cc:460] Webserver started at http://127.11.46.129:38411/ using document root <none> and password file <none>
I20260807 10:46:11.265050 30742 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:11.265341 30742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 10:46:11 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099571, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:46:11.304466 30742 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.004s sys 0.001s
I20260807 10:46:11.318569 30817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:11.321197 30742 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.001s sys 0.011s
I20260807 10:46:11.321553 30742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "a6777e5dd1454d5c92238301d99c5bd2"
format_stamp: "Formatted at 2026-08-07 10:46:07 on dist-test-slave-42z9"
server_key: "f4b3f5d235977f7fb0499ad0604c450f"
server_key_iv: "4fd6467f41100e61561f5a7dd7c1c931"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:11.323199 30742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:11.359992 30742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:11.365001 30742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:11.365429 30742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:11.367033 30742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:11.369318 30742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:11.369522 30742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 10:46:11.369709 30742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:11.369834 30742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:11.425604 30742 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:45409
I20260807 10:46:11.425684 30986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:45409 every 8 connection(s)
I20260807 10:46:11.427536 30742 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:46:11.437634 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 30742
I20260807 10:46:11.438512 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:56759/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:34037
--local_ip_for_outbound_sockets=127.11.46.130
--tserver_master_addrs=127.11.46.190:36063
--webserver_port=33443
--webserver_interface=127.11.46.130
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.46.148:56759/kms with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:46:11 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099571, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:11.490329 30990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:11.431759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36063 (local address 127.11.46.129:49021)
0807 10:46:11.457033 (+ 25274us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:11.457105 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:11.460062 (+ 2957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:11.463064 (+ 3002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:11.463078 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:11.463896 (+ 818us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:11.464898 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:11.464937 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:11.467607 (+ 2670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:11.467614 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:11.470054 (+ 2440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:11.470098 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:11.472532 (+ 2434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:11.472541 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:11.472888 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:11.473923 (+ 1035us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:11.473971 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:11.478181 (+ 4210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:11.483678 (+ 5497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:11.483691 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:11.483713 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:11.484460 (+ 747us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:11.485215 (+ 755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:11.485221 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:11.485225 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:11.485599 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:11.486998 (+ 1399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:11.487007 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:11.487526 (+ 519us) client_negotiation.cc:769] Sending connection context
0807 10:46:11.487874 (+ 348us) client_negotiation.cc:240] Negotiation successful
0807 10:46:11.488597 (+ 723us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24967,"thread_start_us":24758,"threads_started":1}
I20260807 10:46:11.492197 30989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:11.431706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:49021 (local address 127.11.46.190:36063)
0807 10:46:11.456327 (+ 24621us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:11.456374 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:11.457539 (+ 1165us) server_negotiation.cc:407] Connection header received
0807 10:46:11.461121 (+ 3582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:11.461143 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:11.461834 (+ 691us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:11.462410 (+ 576us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:11.465223 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:11.467322 (+ 2099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:11.470401 (+ 3079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:11.471689 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:11.471983 (+ 294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:11.478707 (+ 6724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:11.478724 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:11.478752 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:11.478825 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:11.483375 (+ 4550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:11.484719 (+ 1344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:11.484732 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:11.484741 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:11.485061 (+ 320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:11.485765 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:11.485772 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:11.485776 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:11.486631 (+ 855us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:11.486885 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:11.489919 (+ 3034us) server_negotiation.cc:299] Negotiation successful
0807 10:46:11.490437 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24217,"thread_start_us":24305,"threads_started":1}
I20260807 10:46:11.496487 30987 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36063
I20260807 10:46:11.496954 30987 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:11.498189 30987 heartbeater.cc:511] Master 127.11.46.190:36063 requested a full tablet report, sending...
W20260807 10:46:11.502893 30987 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:36063 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 10:46:11.503365 30987 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:11.503823 30987 heartbeater.cc:511] Master 127.11.46.190:36063 requested a full tablet report, sending...
I20260807 10:46:11.505714 30987 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:11.506183 30987 heartbeater.cc:511] Master 127.11.46.190:36063 requested a full tablet report, sending...
W20260807 10:46:11.507786 30987 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 10:46:11.918145 30991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:11.918617 30991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:11.918792 30991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:11.931248 30991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:11.931424 30991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:11.931619 30991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:46:11.944463 30991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.46.148:56759/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:34037
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=33443
--tserver_master_addrs=127.11.46.190:36063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:11.946165 30991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:11.947738 30991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:11.986996 31011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:11.988394 31012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:11.990875 31017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:11.992483 30991 server_base.cc:1034] running on GCE node
I20260807 10:46:11.993552 30991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:11.996726 30991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:11.998124 30991 hybrid_clock.cc:648] HybridClock initialized: now 1786099571998054 us; error 87 us; skew 500 ppm
I20260807 10:46:11.998670 30991 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:11 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099571, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:12.003804 30991 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:46:12.023476 30991 webserver.cc:460] Webserver started at http://127.11.46.130:33443/ using document root <none> and password file <none>
I20260807 10:46:12.024498 30991 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:12.024686 30991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 10:46:12 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099571, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:46:12.051867 30991 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:46:12.055344 31028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:12.057209 30991 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 10:46:12.057482 30991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "67af5e457eb34c7993c93d0096c47001"
format_stamp: "Formatted at 2026-08-07 10:46:08 on dist-test-slave-42z9"
server_key: "5235a23c022380e20431578c903d7b72"
server_key_iv: "9a7075cd37f8fb0d6ac7eaf3370d387c"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:12.058696 30991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:12.083089 30991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:12.087802 30991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:12.088119 30991 kserver.cc:163] Server-wide thread pool size limit: 3276
Aug 07 10:46:12 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786099572, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:12.089747 30991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:12.091439 30991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:12.091554 30991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:12.091677 30991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:12.091750 30991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:12.162236 30991 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:34037
I20260807 10:46:12.162281 31189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:34037 every 8 connection(s)
I20260807 10:46:12.164224 30991 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:46:12.169111 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 30991
I20260807 10:46:12.170233 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.46.148:56759/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:39625
--local_ip_for_outbound_sockets=127.11.46.131
--tserver_master_addrs=127.11.46.190:36063
--webserver_port=46047
--webserver_interface=127.11.46.131
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.46.148:56759/kms with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:46:12 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099571, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:12.218942 31194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:12.167932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:58945 (local address 127.11.46.190:36063)
0807 10:46:12.189505 (+ 21573us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:12.189513 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:12.193569 (+ 4056us) server_negotiation.cc:407] Connection header received
0807 10:46:12.193932 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:12.193939 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:12.194053 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:12.194169 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:12.196830 (+ 2661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:12.197998 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:12.200766 (+ 2768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:12.201404 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:12.201547 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:12.206475 (+ 4928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:12.206483 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:12.206488 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:12.206544 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:12.210203 (+ 3659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:12.214619 (+ 4416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:12.214628 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:12.214631 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:12.214851 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:12.216185 (+ 1334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:12.216193 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:12.216196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:12.216684 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:12.216845 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:12.218208 (+ 1363us) server_negotiation.cc:299] Negotiation successful
0807 10:46:12.218522 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21345,"thread_start_us":25554,"threads_started":1}
I20260807 10:46:12.221837 31195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:12.168786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36063 (local address 127.11.46.130:58945)
0807 10:46:12.190234 (+ 21448us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:12.190318 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:12.193119 (+ 2801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:12.194862 (+ 1743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:12.194878 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:12.195643 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:12.196548 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:12.196580 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:12.198262 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:12.198268 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:12.200524 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:12.200548 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:12.201939 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:12.201946 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:12.202359 (+ 413us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:12.203296 (+ 937us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:12.203332 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:12.206117 (+ 2785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:12.213463 (+ 7346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:12.213478 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:12.213503 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:12.214377 (+ 874us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:12.215068 (+ 691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:12.215073 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:12.215076 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:12.215430 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:12.217000 (+ 1570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:12.217010 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:12.217630 (+ 620us) client_negotiation.cc:769] Sending connection context
0807 10:46:12.219222 (+ 1592us) client_negotiation.cc:240] Negotiation successful
0807 10:46:12.220049 (+ 827us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21054,"thread_start_us":20800,"threads_started":1}
I20260807 10:46:12.224023 31190 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36063
I20260807 10:46:12.224453 31190 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:12.225562 31190 heartbeater.cc:511] Master 127.11.46.190:36063 requested a full tablet report, sending...
I20260807 10:46:12.228170 30688 ts_manager.cc:194] Registered new tserver with Master: 67af5e457eb34c7993c93d0096c47001 (127.11.46.130:34037)
I20260807 10:46:12.230592 30688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:58945
I20260807 10:46:12.507933 30987 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:12.508495 30987 heartbeater.cc:511] Master 127.11.46.190:36063 requested a full tablet report, sending...
I20260807 10:46:12.509989 30688 ts_manager.cc:194] Registered new tserver with Master: a6777e5dd1454d5c92238301d99c5bd2 (127.11.46.129:45409)
I20260807 10:46:12.511294 30688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:49021
Aug 07 10:46:12 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099572, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
W20260807 10:46:12.710074 31198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:12.710434 31198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:12.710625 31198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:12.718554 31198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:12.718712 31198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:12.718915 31198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:46:12.730943 31198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.46.148:56759/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:39625
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=46047
--tserver_master_addrs=127.11.46.190:36063
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:12.732515 31198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:12.734387 31198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:12.751400 31205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:12.751972 31204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:12.752122 31207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:12.752897 31198 server_base.cc:1034] running on GCE node
I20260807 10:46:12.753847 31198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:12.755312 31198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:12.756599 31198 hybrid_clock.cc:648] HybridClock initialized: now 1786099572756548 us; error 47 us; skew 500 ppm
I20260807 10:46:12.757036 31198 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:12 dist-test-slave-42z9 krb5kdc[29197](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099572, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:12.761384 31198 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:46:12.763532 31198 webserver.cc:460] Webserver started at http://127.11.46.131:46047/ using document root <none> and password file <none>
I20260807 10:46:12.764665 31198 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:12.764853 31198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 10:46:12 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099572, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:46:12.790450 31198 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:46:12.795303 31216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:12.797780 31198 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:46:12.798049 31198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "a8e230bb28534bd69aedc62216e45d32"
format_stamp: "Formatted at 2026-08-07 10:46:09 on dist-test-slave-42z9"
server_key: "b26fbd755c8966e469b2d3b549ff389a"
server_key_iv: "ea422cd0fa4675d2c3442ae2c71ee2d0"
server_key_version: "kuduclusterkey@0"
I20260807 10:46:12.799755 31198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:12.836421 31198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:12.842646 31198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:12.843060 31198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:12.844522 31198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:12.846732 31198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:12.846863 31198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:12.847002 31198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:12.847095 31198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:12.920960 31198 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:39625
I20260807 10:46:12.921213 31365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:39625 every 8 connection(s)
I20260807 10:46:12.923727 31198 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:46:12.931213 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 31198
I20260807 10:46:12.964726 31369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:12.932915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45008 (local address 127.11.46.190:36063)
0807 10:46:12.935007 (+ 2092us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:12.935014 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:12.938746 (+ 3732us) server_negotiation.cc:407] Connection header received
0807 10:46:12.941153 (+ 2407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:12.941162 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:12.941291 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:12.941477 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:12.943686 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:12.944804 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:12.947983 (+ 3179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:12.948701 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:12.948863 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:12.953794 (+ 4931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:12.953800 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:12.953803 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:12.953859 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:12.957566 (+ 3707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:12.960225 (+ 2659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:12.960231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:12.960234 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:12.960412 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:12.961418 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:12.961423 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:12.961426 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:12.961862 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:12.962174 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:12.963866 (+ 1692us) server_negotiation.cc:299] Negotiation successful
0807 10:46:12.964162 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1932,"thread_start_us":1796,"threads_started":1}
Aug 07 10:46:12 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099572, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
Aug 07 10:46:12 dist-test-slave-42z9 krb5kdc[29197](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099572, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for HTTP/127.11.46.148@KRBTEST.COM
I20260807 10:46:12.981632 31370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:12.936431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:36063 (local address 127.11.46.131:40419)
0807 10:46:12.944340 (+ 7909us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:12.944429 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:12.950832 (+ 6403us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:12.952371 (+ 1539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:12.952387 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:12.953108 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:12.955376 (+ 2268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:12.955494 (+ 118us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:12.957658 (+ 2164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:12.957663 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:12.959117 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:12.959142 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:12.960715 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:12.960725 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:12.961038 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:12.962387 (+ 1349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:12.962421 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:12.967134 (+ 4713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:12.975609 (+ 8475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:12.975622 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:12.975647 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:12.976412 (+ 765us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:12.977029 (+ 617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:12.977035 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:12.977039 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:12.977384 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:12.978258 (+ 874us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:12.978268 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:12.978851 (+ 583us) client_negotiation.cc:769] Sending connection context
0807 10:46:12.979216 (+ 365us) client_negotiation.cc:240] Negotiation successful
0807 10:46:12.979945 (+ 729us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7503,"thread_start_us":7191,"threads_started":1}
I20260807 10:46:12.985260 31372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:12.937221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:40419 (local address 127.11.46.190:36063)
0807 10:46:12.945917 (+ 8696us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:12.945923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:12.945946 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:46:12.951453 (+ 5507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:12.951460 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:12.951595 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:12.951713 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:12.955995 (+ 4282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:12.957349 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:12.959297 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:12.959971 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:12.960109 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:12.967530 (+ 7421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:12.967538 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:12.967543 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:12.967599 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:12.975318 (+ 7719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:12.976628 (+ 1310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:12.976635 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:12.976639 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:12.976846 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:12.977589 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:12.977595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:12.977598 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:12.978001 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:12.978165 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:12.982222 (+ 4057us) server_negotiation.cc:299] Negotiation successful
0807 10:46:12.984021 (+ 1799us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8538,"spinlock_wait_cycles":1280,"thread_start_us":8689,"threads_started":1}
I20260807 10:46:12.987494 31366 heartbeater.cc:347] Connected to a master server at 127.11.46.190:36063
I20260807 10:46:12.987867 31366 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:12.988737 31366 heartbeater.cc:511] Master 127.11.46.190:36063 requested a full tablet report, sending...
I20260807 10:46:12.990777 30688 ts_manager.cc:194] Registered new tserver with Master: a8e230bb28534bd69aedc62216e45d32 (127.11.46.131:39625)
I20260807 10:46:12.992048 30688 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:40419
I20260807 10:46:12.997908 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:46:13.032591 31372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.003927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45014 (local address 127.11.46.190:36063)
0807 10:46:13.004137 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:13.004144 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:13.012993 (+ 8849us) server_negotiation.cc:407] Connection header received
0807 10:46:13.013356 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:13.013363 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:13.013534 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:13.013625 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:13.016170 (+ 2545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.017319 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.019686 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.020431 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.020564 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.025010 (+ 4446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:13.025020 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:13.025025 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:13.025084 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:13.028953 (+ 3869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:13.030041 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:13.030049 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:13.030053 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:13.030247 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:13.030765 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:13.030770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:13.030773 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:13.031188 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:13.031449 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:13.031906 (+ 457us) server_negotiation.cc:299] Negotiation successful
0807 10:46:13.032187 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:46:13.039443 30688 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45014:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:46:13.051647 30688 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:46:13.152930 31391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.086999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:39625 (local address 127.0.0.1:52904)
0807 10:46:13.125939 (+ 38940us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:13.125968 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:13.134777 (+ 8809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:13.136404 (+ 1627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:13.136410 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:13.136447 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:13.136808 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:13.136823 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.140476 (+ 3653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.140495 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:13.142969 (+ 2474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:13.142994 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.151742 (+ 8748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.151749 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:13.152034 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.152104 (+ 70us) client_negotiation.cc:769] Sending connection context
0807 10:46:13.152275 (+ 171us) client_negotiation.cc:240] Negotiation successful
0807 10:46:13.152525 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38748,"thread_start_us":39106,"threads_started":1}
I20260807 10:46:13.157559 31389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.086705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57210 (local address 127.11.46.129:45409)
0807 10:46:13.128901 (+ 42196us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:13.128915 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:13.128969 (+ 54us) server_negotiation.cc:407] Connection header received
0807 10:46:13.129140 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:13.129151 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:13.129582 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:13.135541 (+ 5959us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:13.135863 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.137569 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.147435 (+ 9866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.149041 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.156422 (+ 7381us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.156792 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:13.156912 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 10:46:13.157142 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39080,"thread_start_us":46173,"threads_started":1}
I20260807 10:46:13.158751 31388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.086031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52904 (local address 127.11.46.131:39625)
0807 10:46:13.131972 (+ 45941us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:13.131993 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:13.132044 (+ 51us) server_negotiation.cc:407] Connection header received
0807 10:46:13.135055 (+ 3011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:13.135065 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:13.135411 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:13.135655 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:13.137043 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.139299 (+ 2256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.146270 (+ 6971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.148170 (+ 1900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.148335 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.148658 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:13.158102 (+ 9444us) server_negotiation.cc:299] Negotiation successful
0807 10:46:13.158334 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45626,"thread_start_us":47101,"threads_started":1}
I20260807 10:46:13.156177 31385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.086166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45409 (local address 127.0.0.1:57210)
0807 10:46:13.101974 (+ 15808us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:13.102103 (+ 129us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:13.102609 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:13.134625 (+ 32016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:13.134634 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:13.134687 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:13.135255 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:13.135272 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.144740 (+ 9468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.144748 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:13.147092 (+ 2344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:13.147120 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.155192 (+ 8072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.155199 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:13.155407 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.155448 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 10:46:13.155528 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 10:46:13.155689 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15107,"thread_start_us":16681,"threads_started":1}
I20260807 10:46:13.167224 31277 tablet_service.cc:1467] Processing CreateTablet for tablet d316caac41c744b7b6433e7f851a1997 (DEFAULT_TABLE table=test-table [id=82be9ffcfebb46e8b11f1c11a28602b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:13.172880 30887 tablet_service.cc:1467] Processing CreateTablet for tablet d316caac41c744b7b6433e7f851a1997 (DEFAULT_TABLE table=test-table [id=82be9ffcfebb46e8b11f1c11a28602b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:13.174314 31394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.133913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:34037 (local address 127.0.0.1:58344)
0807 10:46:13.150158 (+ 16245us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:13.150183 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:13.150355 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:13.153349 (+ 2994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:13.153354 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:13.153390 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:13.153781 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:13.153798 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.155880 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.155886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:13.170758 (+ 14872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:13.170781 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.173356 (+ 2575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.173364 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:13.173610 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.173652 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 10:46:13.173760 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 10:46:13.173937 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16088,"thread_start_us":25474,"threads_started":1}
I20260807 10:46:13.175201 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.126976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58344 (local address 127.11.46.130:34037)
0807 10:46:13.149356 (+ 22380us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:13.149367 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:13.150526 (+ 1159us) server_negotiation.cc:407] Connection header received
0807 10:46:13.150659 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:13.150667 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:13.151023 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:13.151272 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:13.154047 (+ 2775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.155690 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.171031 (+ 15341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.172659 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.172848 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.173134 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:13.174606 (+ 1472us) server_negotiation.cc:299] Negotiation successful
0807 10:46:13.174840 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22155,"thread_start_us":22399,"threads_started":1}
I20260807 10:46:13.175515 31277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d316caac41c744b7b6433e7f851a1997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:13.177701 30887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d316caac41c744b7b6433e7f851a1997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:13.180651 31097 tablet_service.cc:1467] Processing CreateTablet for tablet d316caac41c744b7b6433e7f851a1997 (DEFAULT_TABLE table=test-table [id=82be9ffcfebb46e8b11f1c11a28602b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:13.182612 31097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d316caac41c744b7b6433e7f851a1997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:13.223125 31395 tablet_bootstrap.cc:492] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: Bootstrap starting.
I20260807 10:46:13.223389 31397 tablet_bootstrap.cc:492] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: Bootstrap starting.
I20260807 10:46:13.227185 31396 tablet_bootstrap.cc:492] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: Bootstrap starting.
I20260807 10:46:13.227990 31397 tablet_bootstrap.cc:654] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:13.232033 31397 log.cc:824] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:13.234041 31396 tablet_bootstrap.cc:654] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:13.235245 31395 tablet_bootstrap.cc:654] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:13.236723 31190 heartbeater.cc:503] Master 127.11.46.190:36063 was elected leader, sending a full tablet report...
I20260807 10:46:13.242458 31397 tablet_bootstrap.cc:492] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: No bootstrap required, opened a new log
I20260807 10:46:13.242913 31397 ts_tablet_manager.cc:1397] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.003s
I20260807 10:46:13.244515 31395 log.cc:824] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:13.248314 31396 log.cc:824] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:13.255307 31397 raft_consensus.cc:348] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e230bb28534bd69aedc62216e45d32" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39625 } } peers { permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 } } peers { permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 } }
I20260807 10:46:13.256093 31397 raft_consensus.cc:374] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:13.256278 31397 raft_consensus.cc:729] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8e230bb28534bd69aedc62216e45d32, State: Initialized, Role: FOLLOWER
I20260807 10:46:13.257301 31395 tablet_bootstrap.cc:492] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: No bootstrap required, opened a new log
I20260807 10:46:13.257750 31395 ts_tablet_manager.cc:1397] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.004s
I20260807 10:46:13.257782 31397 consensus_queue.cc:260] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e230bb28534bd69aedc62216e45d32" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39625 } } peers { permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 } } peers { permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 } }
I20260807 10:46:13.265995 31396 tablet_bootstrap.cc:492] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: No bootstrap required, opened a new log
I20260807 10:46:13.266228 31366 heartbeater.cc:503] Master 127.11.46.190:36063 was elected leader, sending a full tablet report...
I20260807 10:46:13.266464 31396 ts_tablet_manager.cc:1397] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.005s
I20260807 10:46:13.267627 31397 ts_tablet_manager.cc:1428] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: Time spent starting tablet: real 0.025s user 0.012s sys 0.008s
I20260807 10:46:13.274421 31403 raft_consensus.cc:482] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:46:13.275243 31403 raft_consensus.cc:504] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e230bb28534bd69aedc62216e45d32" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39625 } } peers { permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 } } peers { permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 } }
I20260807 10:46:13.284791 31395 raft_consensus.cc:348] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e230bb28534bd69aedc62216e45d32" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39625 } } peers { permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 } } peers { permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 } }
I20260807 10:46:13.287624 31370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.278678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:34037 (local address 127.11.46.131:51157)
0807 10:46:13.279169 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:13.279191 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:13.279323 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:13.280353 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:13.280361 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:13.280408 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:13.280682 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:13.280698 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.282396 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.282403 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:13.284660 (+ 2257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:13.284685 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.286719 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.286727 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:13.286957 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.287010 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 10:46:13.287123 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 10:46:13.287291 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344}
I20260807 10:46:13.288960 31396 raft_consensus.cc:348] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e230bb28534bd69aedc62216e45d32" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39625 } } peers { permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 } } peers { permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 } }
I20260807 10:46:13.289719 31395 raft_consensus.cc:374] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:13.288594 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.279707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:51157 (local address 127.11.46.130:34037)
0807 10:46:13.279947 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:13.279953 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:13.279978 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:46:13.280052 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:13.280057 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:13.280157 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:13.280268 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:13.280915 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.282175 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.284916 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.286295 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.286497 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.286584 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:13.288155 (+ 1571us) server_negotiation.cc:299] Negotiation successful
0807 10:46:13.288325 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 10:46:13.290081 31396 raft_consensus.cc:374] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:13.289889 31395 raft_consensus.cc:729] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67af5e457eb34c7993c93d0096c47001, State: Initialized, Role: FOLLOWER
I20260807 10:46:13.291051 31395 consensus_queue.cc:260] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e230bb28534bd69aedc62216e45d32" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39625 } } peers { permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 } } peers { permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 } }
I20260807 10:46:13.291325 31127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316caac41c744b7b6433e7f851a1997" candidate_uuid: "a8e230bb28534bd69aedc62216e45d32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67af5e457eb34c7993c93d0096c47001" is_pre_election: true
I20260807 10:46:13.291844 31396 raft_consensus.cc:729] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6777e5dd1454d5c92238301d99c5bd2, State: Initialized, Role: FOLLOWER
I20260807 10:46:13.291973 31127 raft_consensus.cc:2454] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8e230bb28534bd69aedc62216e45d32 in term 0.
I20260807 10:46:13.292752 31396 consensus_queue.cc:260] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e230bb28534bd69aedc62216e45d32" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39625 } } peers { permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 } } peers { permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 } }
I20260807 10:46:13.293395 31217 leader_election.cc:302] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67af5e457eb34c7993c93d0096c47001, a8e230bb28534bd69aedc62216e45d32; no voters:
I20260807 10:46:13.298409 31389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.283603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:40631 (local address 127.11.46.129:45409)
0807 10:46:13.283814 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:13.283822 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:13.289198 (+ 5376us) server_negotiation.cc:407] Connection header received
0807 10:46:13.289549 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:13.289555 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:13.289648 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:13.289721 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:13.290783 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.291973 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.295542 (+ 3569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.296903 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.297119 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.297207 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:13.297937 (+ 730us) server_negotiation.cc:299] Negotiation successful
0807 10:46:13.298123 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 10:46:13.298868 31403 leader_election.cc:288] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67af5e457eb34c7993c93d0096c47001 (127.11.46.130:34037), a6777e5dd1454d5c92238301d99c5bd2 (127.11.46.129:45409)
I20260807 10:46:13.299515 31370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.282990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45409 (local address 127.11.46.131:40631)
0807 10:46:13.289093 (+ 6103us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:13.289115 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:13.289333 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:13.290326 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:13.290331 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:13.290366 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:13.290584 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:13.290599 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.292199 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.292205 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:13.295306 (+ 3101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:13.295329 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.297420 (+ 2091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.297427 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:13.297697 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.297741 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 10:46:13.298957 (+ 1216us) client_negotiation.cc:240] Negotiation successful
0807 10:46:13.299144 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5968,"thread_start_us":15529,"threads_started":1}
I20260807 10:46:13.300439 30987 heartbeater.cc:503] Master 127.11.46.190:36063 was elected leader, sending a full tablet report...
I20260807 10:46:13.301684 31396 ts_tablet_manager.cc:1428] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: Time spent starting tablet: real 0.035s user 0.011s sys 0.008s
I20260807 10:46:13.299484 31403 raft_consensus.cc:2781] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:46:13.302337 31403 raft_consensus.cc:482] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:46:13.302475 31403 raft_consensus.cc:3037] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:13.302717 30916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316caac41c744b7b6433e7f851a1997" candidate_uuid: "a8e230bb28534bd69aedc62216e45d32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6777e5dd1454d5c92238301d99c5bd2" is_pre_election: true
I20260807 10:46:13.303357 30916 raft_consensus.cc:2454] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8e230bb28534bd69aedc62216e45d32 in term 0.
I20260807 10:46:13.307569 31395 ts_tablet_manager.cc:1428] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: Time spent starting tablet: real 0.050s user 0.012s sys 0.008s
I20260807 10:46:13.308050 31403 raft_consensus.cc:504] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e230bb28534bd69aedc62216e45d32" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39625 } } peers { permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 } } peers { permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 } }
I20260807 10:46:13.309044 31403 leader_election.cc:288] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [CANDIDATE]: Term 1 election: Requested vote from peers 67af5e457eb34c7993c93d0096c47001 (127.11.46.130:34037), a6777e5dd1454d5c92238301d99c5bd2 (127.11.46.129:45409)
I20260807 10:46:13.309568 31127 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316caac41c744b7b6433e7f851a1997" candidate_uuid: "a8e230bb28534bd69aedc62216e45d32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67af5e457eb34c7993c93d0096c47001"
I20260807 10:46:13.309823 31127 raft_consensus.cc:3037] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:13.312361 31127 raft_consensus.cc:2454] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8e230bb28534bd69aedc62216e45d32 in term 1.
I20260807 10:46:13.312964 31217 leader_election.cc:302] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67af5e457eb34c7993c93d0096c47001, a8e230bb28534bd69aedc62216e45d32; no voters:
I20260807 10:46:13.314833 30916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316caac41c744b7b6433e7f851a1997" candidate_uuid: "a8e230bb28534bd69aedc62216e45d32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6777e5dd1454d5c92238301d99c5bd2"
I20260807 10:46:13.315124 30916 raft_consensus.cc:3037] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:13.317544 30916 raft_consensus.cc:2454] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8e230bb28534bd69aedc62216e45d32 in term 1.
I20260807 10:46:13.317689 31403 raft_consensus.cc:2781] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:46:13.317899 31403 raft_consensus.cc:686] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 1 LEADER]: Becoming Leader. State: Replica: a8e230bb28534bd69aedc62216e45d32, State: Running, Role: LEADER
I20260807 10:46:13.318655 31403 consensus_queue.cc:237] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e230bb28534bd69aedc62216e45d32" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39625 } } peers { permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 } } peers { permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 } }
I20260807 10:46:13.325279 30688 catalog_manager.cc:5495] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8e230bb28534bd69aedc62216e45d32 (127.11.46.131). New cstate: current_term: 1 leader_uuid: "a8e230bb28534bd69aedc62216e45d32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8e230bb28534bd69aedc62216e45d32" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 } health_report { overall_health: UNKNOWN } } }
I20260807 10:46:13.378495 31388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.372472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52910 (local address 127.11.46.131:39625)
0807 10:46:13.372702 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:13.372708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:13.372853 (+ 145us) server_negotiation.cc:407] Connection header received
0807 10:46:13.373094 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:13.373099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:13.373200 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:13.373353 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:46:13.373822 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.374577 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.376054 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.376477 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.376607 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.377201 (+ 594us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:46:13.377841 (+ 640us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:46:13.377992 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:13.378123 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 10:46:13.378222 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 10:46:13.389228 30916 raft_consensus.cc:1261] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2 [term 1 FOLLOWER]: Refusing update from remote peer a8e230bb28534bd69aedc62216e45d32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:46:13.389353 31127 raft_consensus.cc:1261] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001 [term 1 FOLLOWER]: Refusing update from remote peer a8e230bb28534bd69aedc62216e45d32: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:46:13.390456 31404 consensus_queue.cc:1035] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6777e5dd1454d5c92238301d99c5bd2" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:46:13.390971 31403 consensus_queue.cc:1035] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67af5e457eb34c7993c93d0096c47001" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 34037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:46:13.414995 31422 mvcc.cc:205] Tried to move back new op lower bound from 7315863852588679168 to 7315863852319911936. Current Snapshot: MvccSnapshot[applied={T|T < 7315863852588679168}]
I20260807 10:46:13.416687 31425 mvcc.cc:205] Tried to move back new op lower bound from 7315863852588679168 to 7315863852319911936. Current Snapshot: MvccSnapshot[applied={T|T < 7315863852588679168}]
I20260807 10:46:13.435436 30687 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:46:13.435856 30687 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:46:13.441191 30687 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f4abf106282430c9279c72a26c56c01: Sending DeleteTablet for 3 replicas of tablet d316caac41c744b7b6433e7f851a1997
I20260807 10:46:13.442579 31277 tablet_service.cc:1514] Processing DeleteTablet for tablet d316caac41c744b7b6433e7f851a1997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:13 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:52904
I20260807 10:46:13.443225 30887 tablet_service.cc:1514] Processing DeleteTablet for tablet d316caac41c744b7b6433e7f851a1997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:13 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:57210
I20260807 10:46:13.443681 31097 tablet_service.cc:1514] Processing DeleteTablet for tablet d316caac41c744b7b6433e7f851a1997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:13 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:58344
I20260807 10:46:13.444454 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 30742
I20260807 10:46:13.458063 31443 tablet_replica.cc:330] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: stopping tablet replica
I20260807 10:46:13.458717 31443 raft_consensus.cc:2229] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:46:13.459498 31443 raft_consensus.cc:2258] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:13.461797 31440 tablet_replica.cc:330] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: stopping tablet replica
I20260807 10:46:13.462466 31440 raft_consensus.cc:2229] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:46:13.462837 31443 ts_tablet_manager.cc:1905] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:13.463382 31440 raft_consensus.cc:2258] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:13.465759 31441 tablet_replica.cc:330] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: stopping tablet replica
I20260807 10:46:13.466241 31441 raft_consensus.cc:2229] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:46:13.466797 31441 raft_consensus.cc:2258] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:13.467777 31440 ts_tablet_manager.cc:1905] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:13.473552 31443 ts_tablet_manager.cc:1918] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:13.475299 31443 log.cc:1196] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/d316caac41c744b7b6433e7f851a1997
I20260807 10:46:13.475423 31441 ts_tablet_manager.cc:1905] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:13.478792 31389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.445971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57214 (local address 127.11.46.129:45409)
0807 10:46:13.446129 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:13.446134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:13.446152 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:46:13.446205 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:13.446210 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:13.446309 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:13.446406 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:13.448903 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.450148 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.455257 (+ 5109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.455969 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.456123 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.459663 (+ 3540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:13.459686 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:13.459707 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:13.459758 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:13.474979 (+ 15221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:13.476076 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:13.476089 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:13.476092 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:13.476307 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:13.476756 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:13.476762 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:13.476766 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:13.477328 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:13.477736 (+ 408us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:13.478026 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 10:46:13.478332 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 10:46:13.479871 30979 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:13.482050 31440 ts_tablet_manager.cc:1918] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:13.482345 31440 log.cc:1196] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/d316caac41c744b7b6433e7f851a1997
I20260807 10:46:13.482997 31440 ts_tablet_manager.cc:1939] T d316caac41c744b7b6433e7f851a1997 P a8e230bb28534bd69aedc62216e45d32: Deleting consensus metadata
I20260807 10:46:13.485059 30661 catalog_manager.cc:4841] TS a8e230bb28534bd69aedc62216e45d32 (127.11.46.131:39625): tablet d316caac41c744b7b6433e7f851a1997 (table test-table [id=82be9ffcfebb46e8b11f1c11a28602b6]) successfully deleted
I20260807 10:46:13.476660 31443 ts_tablet_manager.cc:1939] T d316caac41c744b7b6433e7f851a1997 P 67af5e457eb34c7993c93d0096c47001: Deleting consensus metadata
I20260807 10:46:13.487787 30661 catalog_manager.cc:4841] TS 67af5e457eb34c7993c93d0096c47001 (127.11.46.130:34037): tablet d316caac41c744b7b6433e7f851a1997 (table test-table [id=82be9ffcfebb46e8b11f1c11a28602b6]) successfully deleted
I20260807 10:46:13.639056 31441 ts_tablet_manager.cc:1918] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:13.639364 31441 log.cc:1196] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/d316caac41c744b7b6433e7f851a1997
I20260807 10:46:13.640038 31441 ts_tablet_manager.cc:1939] T d316caac41c744b7b6433e7f851a1997 P a6777e5dd1454d5c92238301d99c5bd2: Deleting consensus metadata
I20260807 10:46:13.642495 30664 catalog_manager.cc:4841] TS a6777e5dd1454d5c92238301d99c5bd2 (127.11.46.129:45409): tablet d316caac41c744b7b6433e7f851a1997 (table test-table [id=82be9ffcfebb46e8b11f1c11a28602b6]) successfully deleted
I20260807 10:46:13.642777 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 30742
I20260807 10:46:13.683669 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 30991
I20260807 10:46:13.702666 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.684571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58354 (local address 127.11.46.130:34037)
0807 10:46:13.684772 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:13.684779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:13.684890 (+ 111us) server_negotiation.cc:407] Connection header received
0807 10:46:13.685106 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:13.685112 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:13.685203 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:13.685307 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:13.687116 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.688232 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.690128 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.690777 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.690936 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.694568 (+ 3632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:13.694595 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:13.694620 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:13.694680 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:13.698989 (+ 4309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:13.700083 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:13.700095 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:13.700099 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:13.700302 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:13.700734 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:13.700740 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:13.700743 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:13.701279 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:13.701792 (+ 513us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:13.701985 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 10:46:13.702268 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:46:13.703553 31184 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:13.852451 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 30991
I20260807 10:46:13.886547 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 31198
I20260807 10:46:13.904326 31448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:13.887572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52926 (local address 127.11.46.131:39625)
0807 10:46:13.888145 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:13.888150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:13.888168 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:46:13.888226 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:13.888230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:13.888308 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:13.888415 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:13.890371 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.891312 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.893435 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:13.893985 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:13.894135 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:13.897241 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:13.897260 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:13.897280 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:13.897327 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:13.900828 (+ 3501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:13.901854 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:13.901865 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:13.901867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:13.902069 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:13.902497 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:13.902501 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:13.902504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:13.902975 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:13.903306 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:13.903648 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 10:46:13.903916 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":294,"threads_started":1}
I20260807 10:46:13.905125 31359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:14.043172 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 31198
I20260807 10:46:14.080090 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 30641
I20260807 10:46:14.081372 30731 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:14.200719 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 30641
I20260807 10:46:14.239104 11450 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 10:46:14.595192 11450 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 10:46:14.595443 11450 mini_ranger.cc:66] Stopping Ranger...
I20260807 10:46:14.953611 11450 mini_ranger.cc:68] Stopped Ranger
2026-08-07 10:46:14.953 UTC [29239] LOG: received smart shutdown request
2026-08-07 10:46:14.957 UTC [29239] LOG: background worker "logical replication launcher" (PID 29250) exited with exit code 1
2026-08-07 10:46:14.957 UTC [29243] LOG: shutting down
2026-08-07 10:46:15.126 UTC [29239] LOG: database system is shut down
2026-08-07T10:46:15Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (57918 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:46:15 dist-test-slave-42z9 krb5kdc[31467](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:46:15 dist-test-slave-42z9 krb5kdc[31467](info): set up 2 sockets
Aug 07 10:46:15 dist-test-slave-42z9 krb5kdc[31467](info): commencing operation
krb5kdc: starting...
W20260807 10:46:16.503619 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.006s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:46:16 dist-test-slave-42z9 krb5kdc[31467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:46:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:46:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:46:16.863662 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:40081
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:40081,127.11.46.189:45485,127.11.46.188:37347
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:17.252128 31484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:17.252514 31484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:17.252664 31484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:17.260504 31484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:46:17.260669 31484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:17.260756 31484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:17.260834 31484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:46:17.260893 31484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:46:17.271834 31484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:40081,127.11.46.189:45485,127.11.46.188:37347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:40081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:17.273514 31484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:17.275023 31484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:17.288486 31493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:17.288352 31499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:17.288444 31495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:17.289784 31484 server_base.cc:1034] running on GCE node
I20260807 10:46:17.290714 31484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:17.292367 31484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:17.293543 31484 hybrid_clock.cc:648] HybridClock initialized: now 1786099577293489 us; error 42 us; skew 500 ppm
I20260807 10:46:17.293967 31484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:17 dist-test-slave-42z9 krb5kdc[31467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099577, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:17.301025 31484 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:46:17.302925 31484 webserver.cc:460] Webserver started at http://127.11.46.190:42557/ using document root <none> and password file <none>
I20260807 10:46:17.303745 31484 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:17.303876 31484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:17.304229 31484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:17.307709 31484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8"
format_stamp: "Formatted at 2026-08-07 10:46:17 on dist-test-slave-42z9"
server_key: "8207d609087ec88f414ac63bb7c8efc9"
server_key_iv: "db322469c07a31b64cef52d681aca82e"
server_key_version: "encryptionkey@0"
I20260807 10:46:17.308647 31484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8"
format_stamp: "Formatted at 2026-08-07 10:46:17 on dist-test-slave-42z9"
server_key: "8207d609087ec88f414ac63bb7c8efc9"
server_key_iv: "db322469c07a31b64cef52d681aca82e"
server_key_version: "encryptionkey@0"
I20260807 10:46:17.314675 31484 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:46:17.318831 31508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:17.320552 31484 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:46:17.320756 31484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8"
format_stamp: "Formatted at 2026-08-07 10:46:17 on dist-test-slave-42z9"
server_key: "8207d609087ec88f414ac63bb7c8efc9"
server_key_iv: "db322469c07a31b64cef52d681aca82e"
server_key_version: "encryptionkey@0"
I20260807 10:46:17.321000 31484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:17.336282 31484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:17.341104 31484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:17.341405 31484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:17.361778 31484 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:40081
I20260807 10:46:17.361801 31577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:40081 every 8 connection(s)
I20260807 10:46:17.363341 31484 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:46:17.367655 31578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:17.371861 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 31484
I20260807 10:46:17.372135 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:46:17.372969 11450 external_mini_cluster.cc:1428] Setting key a82dfc232254e2a56b60ec119de2c5e3
I20260807 10:46:17.376632 31578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:46:17 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099577, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.46.189@KRBTEST.COM; defaulting to no policy
I20260807 10:46:17.414697 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.381074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40081 (local address 127.0.0.1:48008)
0807 10:46:17.390194 (+ 9120us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.390284 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:17.393195 (+ 2911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:17.394456 (+ 1261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:17.394464 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:17.395359 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:17.395992 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:17.396037 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:17.397941 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:17.397948 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:17.399919 (+ 1971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:17.399943 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:17.401141 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:17.401149 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:17.401322 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:17.402139 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:17.402173 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:17.405184 (+ 3011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:17.409745 (+ 4561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:17.409764 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:17.409780 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:17.410503 (+ 723us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:17.411022 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:17.411027 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:17.411030 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:17.411316 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:17.412248 (+ 932us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:17.412258 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:17.412537 (+ 279us) client_negotiation.cc:769] Sending connection context
0807 10:46:17.412871 (+ 334us) client_negotiation.cc:240] Negotiation successful
0807 10:46:17.413607 (+ 736us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8735,"mutex_wait_us":137,"thread_start_us":8442,"threads_started":1}
I20260807 10:46:17.414736 31581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.381074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48008 (local address 127.11.46.190:40081)
0807 10:46:17.391196 (+ 10122us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:17.391202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:17.391264 (+ 62us) server_negotiation.cc:407] Connection header received
0807 10:46:17.393797 (+ 2533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:17.393805 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:17.394137 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:17.394325 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:17.396269 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:17.397723 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:17.400141 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:17.400807 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:17.400990 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:17.405583 (+ 4593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:17.405599 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:17.405620 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:17.405668 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:17.409538 (+ 3870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:17.410685 (+ 1147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:17.410694 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:17.410697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:17.410885 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:17.411440 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:17.411443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:17.411445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:17.412073 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:17.412251 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:17.412994 (+ 743us) server_negotiation.cc:299] Negotiation successful
0807 10:46:17.413379 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":9851,"spinlock_wait_cycles":71936,"thread_start_us":9550,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.189@KRBTEST.COM" created.
I20260807 10:46:17.418133 31578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:46:17.419462 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.418899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57400)
0807 10:46:17.419118 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.419269 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260807 10:46:17.419754 31510 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
I20260807 10:46:17.421540 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.421067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57414)
0807 10:46:17.421240 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.421335 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 10:46:17.421778 31578 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:45485: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab.
Entry for principal kudu/127.11.46.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab.
I20260807 10:46:17.456394 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.189:45485
--webserver_interface=127.11.46.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab
--principal=kudu/127.11.46.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:40081,127.11.46.189:45485,127.11.46.188:37347
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:46:17.471225 31578 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } attempt: 1
I20260807 10:46:17.472620 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.472091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57424)
0807 10:46:17.472309 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.472477 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 10:46:17.473834 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.473371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57430)
0807 10:46:17.473557 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.473642 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 10:46:17.474058 31578 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:45485: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
I20260807 10:46:17.542335 31578 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } attempt: 2
I20260807 10:46:17.543668 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.543170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57436)
0807 10:46:17.543384 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.543499 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 10:46:17.544744 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.544362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57442)
0807 10:46:17.544507 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.544595 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260807 10:46:17.544945 31578 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:45485: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
I20260807 10:46:17.636236 31578 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } attempt: 3
I20260807 10:46:17.637543 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.636984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57452)
0807 10:46:17.637220 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.637332 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 10:46:17.638854 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.638321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57466)
0807 10:46:17.638520 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.638634 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 10:46:17.639108 31578 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:45485: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
I20260807 10:46:17.782389 31578 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } attempt: 4
I20260807 10:46:17.783844 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.783134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57482)
0807 10:46:17.783518 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.783644 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197}
I20260807 10:46:17.785166 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.784671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57490)
0807 10:46:17.784850 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.784985 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 10:46:17.785375 31578 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:45485: Network error: Client connection negotiation failed: client connection to 127.11.46.189:45485: connect: Connection refused (error 111)
W20260807 10:46:17.846050 31589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:17.846390 31589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:17.846529 31589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:17.854454 31589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:46:17.854605 31589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:17.854665 31589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:17.854754 31589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:46:17.854811 31589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:46:17.865810 31589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:40081,127.11.46.189:45485,127.11.46.188:37347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab
--principal=kudu/127.11.46.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.189:45485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.46.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:17.867399 31589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:17.868884 31589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:17.881913 31599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:17.882072 31595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:17.882047 31597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:17.883081 31589 server_base.cc:1034] running on GCE node
I20260807 10:46:17.884038 31589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:17.885813 31589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:17.887072 31589 hybrid_clock.cc:648] HybridClock initialized: now 1786099577887021 us; error 50 us; skew 500 ppm
I20260807 10:46:17.887497 31589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:17 dist-test-slave-42z9 krb5kdc[31467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099577, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:17.891376 31589 init.cc:377] Logged in from keytab as kudu/127.11.46.189@KRBTEST.COM (short username kudu)
I20260807 10:46:17.893375 31589 webserver.cc:460] Webserver started at http://127.11.46.189:40763/ using document root <none> and password file <none>
I20260807 10:46:17.894271 31589 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:17.894423 31589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:17.894774 31589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:17.898375 31589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/data/instance:
uuid: "c8257e9fd7534946bb6156e4e1696d67"
format_stamp: "Formatted at 2026-08-07 10:46:17 on dist-test-slave-42z9"
server_key: "dc09ee0cf50fe8162902d42f8e91467c"
server_key_iv: "168256727c44a3ffe595ca6b653d4b08"
server_key_version: "encryptionkey@0"
I20260807 10:46:17.899381 31589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/wal/instance:
uuid: "c8257e9fd7534946bb6156e4e1696d67"
format_stamp: "Formatted at 2026-08-07 10:46:17 on dist-test-slave-42z9"
server_key: "dc09ee0cf50fe8162902d42f8e91467c"
server_key_iv: "168256727c44a3ffe595ca6b653d4b08"
server_key_version: "encryptionkey@0"
I20260807 10:46:17.905593 31589 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:46:17.909682 31611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:17.911202 31589 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:46:17.911396 31589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/wal
uuid: "c8257e9fd7534946bb6156e4e1696d67"
format_stamp: "Formatted at 2026-08-07 10:46:17 on dist-test-slave-42z9"
server_key: "dc09ee0cf50fe8162902d42f8e91467c"
server_key_iv: "168256727c44a3ffe595ca6b653d4b08"
server_key_version: "encryptionkey@0"
I20260807 10:46:17.911614 31589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:17.936384 31589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:17.941066 31589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:17.941380 31589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:17.961426 31589 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.189:45485
I20260807 10:46:17.961489 31690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.189:45485 every 8 connection(s)
I20260807 10:46:17.963073 31589 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
I20260807 10:46:17.964656 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 31589
I20260807 10:46:17.964867 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-1/wal/instance
I20260807 10:46:17.965519 11450 external_mini_cluster.cc:1428] Setting key f623c426df25c23c0328fe05a4bb6c56
I20260807 10:46:17.968549 31691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:17.978171 31691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:46:17 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099577, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.46.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.188@KRBTEST.COM" created.
I20260807 10:46:18.005858 31696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.981796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48020 (local address 127.11.46.190:40081)
0807 10:46:17.982343 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:17.982347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:17.983556 (+ 1209us) server_negotiation.cc:407] Connection header received
0807 10:46:17.986575 (+ 3019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:17.986583 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:17.986736 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:17.986905 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:17.989670 (+ 2765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:17.990552 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:17.993224 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:17.993756 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:17.993879 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:17.999056 (+ 5177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:17.999064 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:17.999068 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:17.999119 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.002190 (+ 3071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.003146 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.003153 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.003157 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.003301 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.003796 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.003800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.003802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.004133 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.004286 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.005138 (+ 852us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.005428 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":296,"threads_started":1}
I20260807 10:46:18.007048 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:17.982567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40081 (local address 127.0.0.1:48020)
0807 10:46:17.983361 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:17.983415 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:17.985992 (+ 2577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:17.987373 (+ 1381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:17.987389 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:17.988244 (+ 855us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:17.989295 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:17.989330 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:17.990803 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:17.990810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:17.992997 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:17.993021 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:17.994061 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:17.994069 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:17.994459 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:17.995326 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:17.995368 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:17.998649 (+ 3281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:18.002400 (+ 3751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.002412 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.002429 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.002977 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.003433 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.003439 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.003442 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.003664 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.004285 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:18.004296 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:18.004720 (+ 424us) client_negotiation.cc:769] Sending connection context
0807 10:46:18.005008 (+ 288us) client_negotiation.cc:240] Negotiation successful
0807 10:46:18.005644 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":303,"threads_started":1}
I20260807 10:46:18.009348 31691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099577, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
I20260807 10:46:18.025955 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.010347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57500)
0807 10:46:18.010563 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.010584 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:18.010695 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:18.011796 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:18.011801 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:18.012282 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:18.012442 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.012451 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.013951 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.013955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.014819 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.014832 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.015863 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.015869 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.016066 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.016741 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:18.016767 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:18.019260 (+ 2493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:18.022922 (+ 3662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.022928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.022932 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.023349 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.023781 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.023785 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.023789 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.023952 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.024718 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:18.024723 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:18.024897 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 10:46:18.025071 (+ 174us) client_negotiation.cc:240] Negotiation successful
0807 10:46:18.025416 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 10:46:18.025992 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.010569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57500 (local address 127.11.46.189:45485)
0807 10:46:18.011308 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.011315 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.011344 (+ 29us) server_negotiation.cc:407] Connection header received
0807 10:46:18.011410 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.011416 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.011628 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.011777 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.012605 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.013798 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.014979 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.015689 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.015829 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.019545 (+ 3716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.019563 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.019583 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.019619 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.022740 (+ 3121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.023502 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.023511 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.023513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.023663 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.024062 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.024067 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.024070 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.024527 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.024746 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.025256 (+ 510us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.025589 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":576,"thread_start_us":428,"threads_started":1}
I20260807 10:46:18.029095 31691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:46:18.030457 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.029929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42398)
0807 10:46:18.030137 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.030274 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260807 10:46:18.030764 31612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
I20260807 10:46:18.032608 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.032212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42412)
0807 10:46:18.032376 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.032463 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 10:46:18.032873 31691 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:37347: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab.
Entry for principal kudu/127.11.46.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab.
I20260807 10:46:18.047111 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.188:37347
--webserver_interface=127.11.46.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab
--principal=kudu/127.11.46.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46849
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:40081,127.11.46.189:45485,127.11.46.188:37347
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:46:18.082257 31691 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } attempt: 1
I20260807 10:46:18.083796 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.083163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42422)
0807 10:46:18.083403 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.083586 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 10:46:18.084715 31578 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } attempt: 5
I20260807 10:46:18.085199 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.084585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42430)
0807 10:46:18.084882 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.085002 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
W20260807 10:46:18.085752 31691 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:37347: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099577, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
I20260807 10:46:18.100961 31699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.085596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57506 (local address 127.11.46.189:45485)
0807 10:46:18.085774 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.085780 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.085805 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:46:18.085973 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.085977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.086051 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.086142 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.087193 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.087918 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.089868 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.090426 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.090549 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.094869 (+ 4320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.094876 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.094879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.094925 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.097803 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.098824 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.098830 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.098832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.099002 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.099507 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.099511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.099513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.099853 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.099986 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.100510 (+ 524us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.100716 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:46:18.101104 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.085333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57506)
0807 10:46:18.085628 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.085651 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:18.085796 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:18.086202 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:18.086207 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:18.086744 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:18.087016 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.087030 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.088086 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.088093 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.089636 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.089657 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.090623 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.090630 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.090840 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.091697 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:18.091722 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:18.094546 (+ 2824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:18.098014 (+ 3468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.098020 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.098024 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.098627 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.099131 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.099135 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.099139 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.099355 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.099979 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:18.099984 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:18.100191 (+ 207us) client_negotiation.cc:769] Sending connection context
0807 10:46:18.100391 (+ 200us) client_negotiation.cc:240] Negotiation successful
0807 10:46:18.100734 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144}
I20260807 10:46:18.102345 31578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:46:18.103535 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.103036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42444)
0807 10:46:18.103246 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.103352 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 10:46:18.104635 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.104227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42446)
0807 10:46:18.104413 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.104505 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 10:46:18.104874 31578 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:37347: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
I20260807 10:46:18.154003 31691 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } attempt: 2
I20260807 10:46:18.155301 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.154804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42456)
0807 10:46:18.155018 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.155122 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 10:46:18.156154 31578 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } attempt: 1
I20260807 10:46:18.156585 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.156074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42470)
0807 10:46:18.156291 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.156399 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260807 10:46:18.156971 31691 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:37347: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
I20260807 10:46:18.157303 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.156752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42486)
0807 10:46:18.156955 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.157094 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 10:46:18.158512 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.158108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42488)
0807 10:46:18.158273 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.158367 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 10:46:18.158749 31578 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:37347: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
I20260807 10:46:18.226994 31578 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } attempt: 2
I20260807 10:46:18.228457 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.227770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42492)
0807 10:46:18.228069 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.228207 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 10:46:18.229750 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.229243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42508)
0807 10:46:18.229417 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.229569 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:46:18.230006 31578 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:37347: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
I20260807 10:46:18.248205 31691 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } attempt: 3
I20260807 10:46:18.249640 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.248956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42520)
0807 10:46:18.249222 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.249366 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 10:46:18.251119 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.250478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42528)
0807 10:46:18.250779 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.250907 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
W20260807 10:46:18.251452 31691 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:37347: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
I20260807 10:46:18.336284 31578 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } attempt: 3
I20260807 10:46:18.337677 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.337045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42530)
0807 10:46:18.337289 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.337415 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 10:46:18.338840 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.338427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42546)
0807 10:46:18.338620 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.338710 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
W20260807 10:46:18.339073 31578 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:37347: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
I20260807 10:46:18.394708 31691 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } attempt: 4
I20260807 10:46:18.396021 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.395377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42550)
0807 10:46:18.395664 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.395783 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 10:46:18.397377 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.396997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42564)
0807 10:46:18.397150 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.397234 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:46:18.397622 31691 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:37347: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
W20260807 10:46:18.450898 31702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:18.451256 31702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:18.451354 31702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:18.459286 31702 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:46:18.459457 31702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:18.459509 31702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:18.459569 31702 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:46:18.459614 31702 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:46:18.470409 31702 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46849
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:40081,127.11.46.189:45485,127.11.46.188:37347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab
--principal=kudu/127.11.46.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.188:37347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.46.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:18.471985 31702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:18.473623 31702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:18.487545 31708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:18.487676 31710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:18.487526 31712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:18.493865 31702 server_base.cc:1034] running on GCE node
I20260807 10:46:18.494913 31702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:18.496766 31702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:18.498015 31702 hybrid_clock.cc:648] HybridClock initialized: now 1786099578497958 us; error 51 us; skew 500 ppm
I20260807 10:46:18.498430 31702 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099578, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:18.501955 31702 init.cc:377] Logged in from keytab as kudu/127.11.46.188@KRBTEST.COM (short username kudu)
I20260807 10:46:18.503978 31702 webserver.cc:460] Webserver started at http://127.11.46.188:40103/ using document root <none> and password file <none>
I20260807 10:46:18.504846 31702 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:18.504987 31702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:18.505321 31702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:18.508744 31702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/data/instance:
uuid: "dbacfdc997674b4f876a7b56deab00d5"
format_stamp: "Formatted at 2026-08-07 10:46:18 on dist-test-slave-42z9"
server_key: "7c32f2d2eb6cbc16b02b20cc7da9f985"
server_key_iv: "fe2f6c9071d6f3921b48ae2b7d69fe9f"
server_key_version: "encryptionkey@0"
I20260807 10:46:18.509752 31702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/wal/instance:
uuid: "dbacfdc997674b4f876a7b56deab00d5"
format_stamp: "Formatted at 2026-08-07 10:46:18 on dist-test-slave-42z9"
server_key: "7c32f2d2eb6cbc16b02b20cc7da9f985"
server_key_iv: "fe2f6c9071d6f3921b48ae2b7d69fe9f"
server_key_version: "encryptionkey@0"
I20260807 10:46:18.516065 31702 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:46:18.516299 31578 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } attempt: 4
I20260807 10:46:18.517560 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.517064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42576)
0807 10:46:18.517273 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.517370 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 10:46:18.518666 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.518261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42582)
0807 10:46:18.518431 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.518516 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 10:46:18.518903 31578 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:37347: Network error: Client connection negotiation failed: client connection to 127.11.46.188:37347: connect: Connection refused (error 111)
I20260807 10:46:18.520925 31720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:18.522784 31702 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:46:18.523023 31702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/wal
uuid: "dbacfdc997674b4f876a7b56deab00d5"
format_stamp: "Formatted at 2026-08-07 10:46:18 on dist-test-slave-42z9"
server_key: "7c32f2d2eb6cbc16b02b20cc7da9f985"
server_key_iv: "fe2f6c9071d6f3921b48ae2b7d69fe9f"
server_key_version: "encryptionkey@0"
I20260807 10:46:18.523263 31702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:18.542991 31702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:18.548003 31702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:18.548331 31702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:18.570619 31702 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.188:37347
I20260807 10:46:18.570657 31798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.188:37347 every 8 connection(s)
I20260807 10:46:18.572285 31702 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
I20260807 10:46:18.575717 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 31702
I20260807 10:46:18.575951 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786099355061134-11450-0/minicluster-data/master-2/wal/instance
I20260807 10:46:18.576567 11450 external_mini_cluster.cc:1428] Setting key 5618d8f8c146963c9a010ae65783d3af
I20260807 10:46:18.577189 31801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:18.587512 31801 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099578, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:18.606500 31806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.578890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42588 (local address 127.11.46.188:37347)
0807 10:46:18.579918 (+ 1028us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.579932 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.579990 (+ 58us) server_negotiation.cc:407] Connection header received
0807 10:46:18.582749 (+ 2759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.582784 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.583332 (+ 548us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.583814 (+ 482us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.585682 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.587176 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.588797 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.589657 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.589867 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.597087 (+ 7220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.597096 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.597111 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.597171 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.600864 (+ 3693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.602232 (+ 1368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.602243 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.602255 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.602451 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.602990 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.602995 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.602997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.603769 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.604034 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.604605 (+ 571us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.605062 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":776,"thread_start_us":446,"threads_started":1}
I20260807 10:46:18.608789 31808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.591004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40081 (local address 127.0.0.1:48026)
0807 10:46:18.592000 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.592064 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:18.592272 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:18.593067 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:18.593073 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:18.594005 (+ 932us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:18.594387 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.594403 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.596079 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.596086 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.597635 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.597653 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.598742 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.598749 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.598924 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.599611 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:18.599631 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:18.602146 (+ 2515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:18.605871 (+ 3725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.605883 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.605890 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.606570 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.607041 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.607046 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.607050 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.607255 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.607793 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:18.607800 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:18.608011 (+ 211us) client_negotiation.cc:769] Sending connection context
0807 10:46:18.608181 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 10:46:18.608475 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":499,"threads_started":1}
I20260807 10:46:18.609396 31807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.590662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48026 (local address 127.11.46.190:40081)
0807 10:46:18.591569 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.591577 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.592202 (+ 625us) server_negotiation.cc:407] Connection header received
0807 10:46:18.592492 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.592498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.592816 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.592965 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.594627 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.595865 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.597827 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.598459 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.598613 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.602400 (+ 3787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.602407 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.602411 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.602452 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.605712 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.606754 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.606760 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.606762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.606918 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.607367 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.607371 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.607373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.607667 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.607800 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.608355 (+ 555us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.608615 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":422,"threads_started":1}
I20260807 10:46:18.610886 31801 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099578, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:18.625046 31808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.611640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:45485 (local address 127.0.0.1:57518)
0807 10:46:18.611803 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.611821 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:18.611904 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:18.612568 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:18.612572 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:18.612924 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:18.613085 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.613093 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.614223 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.614228 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.615135 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.615147 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.615984 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.615989 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.616238 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.616764 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:18.616788 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:18.619246 (+ 2458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:18.622535 (+ 3289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.622541 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.622546 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.622948 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.623343 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.623348 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.623352 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.623516 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.624041 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:18.624046 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:18.624205 (+ 159us) client_negotiation.cc:769] Sending connection context
0807 10:46:18.624348 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 10:46:18.624675 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 10:46:18.625391 31807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.610338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48028 (local address 127.11.46.190:40081)
0807 10:46:18.610517 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.610522 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.610545 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:46:18.610730 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.610734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.610809 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.610885 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.612478 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.613280 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.614644 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.615099 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.615233 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.620105 (+ 4872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.620110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.620113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.620148 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.622675 (+ 2527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.623349 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.623354 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.623357 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.623498 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.623860 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.623864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.623866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.624152 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.624434 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.624786 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.625027 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:46:18.625588 31809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.611762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57518 (local address 127.11.46.189:45485)
0807 10:46:18.612274 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.612279 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.612295 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:46:18.612344 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.612348 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.612411 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.612526 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.613236 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.614076 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.615286 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.615802 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.615923 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.619469 (+ 3546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.619475 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.619478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.619517 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.622389 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.623075 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.623080 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.623083 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.623227 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.623627 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.623631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.623633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.623914 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.624061 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.624512 (+ 451us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.624734 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":295,"threads_started":1}
I20260807 10:46:18.626555 31801 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099578, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
I20260807 10:46:18.641373 31808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.627389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42594)
0807 10:46:18.627623 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.627638 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:18.627726 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:18.628051 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:18.628060 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:18.628575 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:18.628796 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.628809 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.629890 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.629894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.631031 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.631047 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.631809 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.631816 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.631974 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.632576 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:18.632594 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:18.635025 (+ 2431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:18.638686 (+ 3661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.638693 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.638696 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.639168 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.639630 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.639633 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.639636 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.639802 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.640499 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:18.640503 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:18.640649 (+ 146us) client_negotiation.cc:769] Sending connection context
0807 10:46:18.640779 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 10:46:18.641043 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154}
I20260807 10:46:18.641673 31806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.627342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42594 (local address 127.11.46.188:37347)
0807 10:46:18.627536 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.627541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.627701 (+ 160us) server_negotiation.cc:407] Connection header received
0807 10:46:18.627826 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.627831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.627903 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.627995 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.628939 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.629766 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.631179 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.631632 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.631729 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.635276 (+ 3547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.635283 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.635289 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.635334 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.638511 (+ 3177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.639305 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.639313 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.639317 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.639482 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.639919 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.639924 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.639928 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.640358 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.640521 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.640927 (+ 406us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.641238 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":60}
I20260807 10:46:18.645128 31809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.627154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57532 (local address 127.11.46.189:45485)
0807 10:46:18.627326 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.627331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.627632 (+ 301us) server_negotiation.cc:407] Connection header received
0807 10:46:18.627680 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.627685 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.627784 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.627870 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.629533 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.630329 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.631823 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.632270 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.632383 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.637983 (+ 5600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.637993 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.637998 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.638052 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.641533 (+ 3481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.642765 (+ 1232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.642772 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.642776 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.643003 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.643559 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.643565 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.643568 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.643910 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.644152 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.644590 (+ 438us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.644829 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:46:18.648572 31801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5: Bootstrap starting.
I20260807 10:46:18.651160 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:46:18.653182 31801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:18.654891 31801 log.cc:824] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:18.661501 31801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5: No bootstrap required, opened a new log
I20260807 10:46:18.674010 31801 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } }
I20260807 10:46:18.674808 31801 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:18.675037 31801 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbacfdc997674b4f876a7b56deab00d5, State: Initialized, Role: FOLLOWER
I20260807 10:46:18.676164 31801 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } }
I20260807 10:46:18.679826 31807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.657983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48032 (local address 127.11.46.190:40081)
0807 10:46:18.658182 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.658188 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.658908 (+ 720us) server_negotiation.cc:407] Connection header received
0807 10:46:18.659226 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.659232 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.659334 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.659470 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.662098 (+ 2628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.663274 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.665768 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.666466 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.666583 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.671274 (+ 4691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.671282 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.671288 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.671347 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.675351 (+ 4004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.676859 (+ 1508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.676866 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.676870 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.677096 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.677713 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.677719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.677723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.678143 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.678402 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.679129 (+ 727us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.679431 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 10:46:18.679839 31806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.658253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42608 (local address 127.11.46.188:37347)
0807 10:46:18.658493 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.658498 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.659178 (+ 680us) server_negotiation.cc:407] Connection header received
0807 10:46:18.659745 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.659751 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.659835 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.659911 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.662346 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.663478 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.665772 (+ 2294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.666543 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.666636 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.671274 (+ 4638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.671282 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.671288 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.671346 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.675351 (+ 4005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.676859 (+ 1508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.676866 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.676870 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.677096 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.677714 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.677719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.677723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.678132 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.678402 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.679129 (+ 727us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.679431 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 10:46:18.679968 31809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.658283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57548 (local address 127.11.46.189:45485)
0807 10:46:18.658472 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.658478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.659981 (+ 1503us) server_negotiation.cc:407] Connection header received
0807 10:46:18.660295 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.660300 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.660390 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.660476 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.662953 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.664100 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.666376 (+ 2276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.667047 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.667151 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.671354 (+ 4203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.671363 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.671368 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.671422 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.675605 (+ 4183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.676918 (+ 1313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.676925 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.676928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.677122 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.677754 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.677762 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.677766 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.678214 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.678498 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.679189 (+ 691us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.679532 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 10:46:18.681365 31823 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } } }
I20260807 10:46:18.681990 31823 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:46:18.683884 31801 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:46:18.696903 31691 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } attempt: 5
W20260807 10:46:18.700961 31838 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:46:18.701314 31838 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:46:18.696630 31702 master_runner.cc:186] Error getting master registration for 127.11.46.190:40081: OK, instance_id { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" instance_seqno: 1786099577355771 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:46:18.708339 31702 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099577, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
I20260807 10:46:18.718441 31806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.697743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42616 (local address 127.11.46.188:37347)
0807 10:46:18.697998 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.698005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.701532 (+ 3527us) server_negotiation.cc:407] Connection header received
0807 10:46:18.701617 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.701623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.701743 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.701862 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.703574 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.704841 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.706693 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.707541 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.707696 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.712078 (+ 4382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.712086 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.712091 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.712141 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.715343 (+ 3202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.716335 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.716339 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.716342 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.716555 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.717009 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.717013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.717015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.717351 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.717530 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.717947 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.718143 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:46:18.718628 31697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.698201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42616)
0807 10:46:18.701150 (+ 2949us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.701176 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:18.701357 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:18.701960 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:18.701966 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:18.702577 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:18.702837 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.702854 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.705024 (+ 2170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.705031 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.706494 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.706518 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.707749 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.707757 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.708023 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.708827 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:18.708850 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:18.711796 (+ 2946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:18.715539 (+ 3743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.715546 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.715550 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.716205 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.716700 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.716705 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.716709 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.716896 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.717511 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:18.717516 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:18.717695 (+ 179us) client_negotiation.cc:769] Sending connection context
0807 10:46:18.717862 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 10:46:18.718200 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2760}
I20260807 10:46:18.725489 31691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67: Bootstrap starting.
I20260807 10:46:18.730469 31691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:18.732120 31691 log.cc:824] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:18.736166 31691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67: No bootstrap required, opened a new log
I20260807 10:46:18.748180 31691 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } }
I20260807 10:46:18.748728 31691 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:18.748869 31691 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8257e9fd7534946bb6156e4e1696d67, State: Initialized, Role: FOLLOWER
I20260807 10:46:18.749816 31691 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } }
I20260807 10:46:18.750962 31842 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } } }
I20260807 10:46:18.751315 31842 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:46:18.752771 31691 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:46:18.754981 31842 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:46:18.755425 31842 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } }
I20260807 10:46:18.757264 31842 leader_election.cc:288] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2bf73cddf4d42e9baf135bc5f60a2f8 (127.11.46.190:40081), dbacfdc997674b4f876a7b56deab00d5 (127.11.46.188:37347)
I20260807 10:46:18.758991 31766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8257e9fd7534946bb6156e4e1696d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbacfdc997674b4f876a7b56deab00d5" is_pre_election: true
I20260807 10:46:18.759850 31766 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8257e9fd7534946bb6156e4e1696d67 in term 0.
I20260807 10:46:18.760974 31612 leader_election.cc:302] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8257e9fd7534946bb6156e4e1696d67, dbacfdc997674b4f876a7b56deab00d5; no voters:
I20260807 10:46:18.762367 31842 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:46:18.762568 31842 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:46:18.762672 31842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:18.766615 31842 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } }
I20260807 10:46:18.768219 31766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8257e9fd7534946bb6156e4e1696d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbacfdc997674b4f876a7b56deab00d5"
I20260807 10:46:18.768541 31766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:18.772439 31766 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8257e9fd7534946bb6156e4e1696d67 in term 1.
I20260807 10:46:18.773002 31612 leader_election.cc:302] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8257e9fd7534946bb6156e4e1696d67, dbacfdc997674b4f876a7b56deab00d5; no voters:
I20260807 10:46:18.773910 31842 leader_election.cc:288] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [CANDIDATE]: Term 1 election: Requested vote from peers e2bf73cddf4d42e9baf135bc5f60a2f8 (127.11.46.190:40081), dbacfdc997674b4f876a7b56deab00d5 (127.11.46.188:37347)
I20260807 10:46:18.779953 31861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:46:18.780340 31861 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [term 1 LEADER]: Becoming Leader. State: Replica: c8257e9fd7534946bb6156e4e1696d67, State: Running, Role: LEADER
I20260807 10:46:18.781620 31861 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } }
I20260807 10:46:18.771276 31589 master_runner.cc:186] Error getting master registration for 127.11.46.190:40081: OK, instance_id { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" instance_seqno: 1786099577355771 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:46:18.789812 31589 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 10:46:18.792821 31860 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:46:18.793005 31860 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:46:18.796100 31578 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } attempt: 5
I20260807 10:46:18.798797 31842 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8257e9fd7534946bb6156e4e1696d67. Latest consensus state: current_term: 1 leader_uuid: "c8257e9fd7534946bb6156e4e1696d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } } }
I20260807 10:46:18.799711 31842 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:18.800884 31866 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260807 10:46:18.801105 31736 tablet.cc:2369] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:46:18.804651 31866 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 10:46:18 dist-test-slave-42z9 krb5kdc[31467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099577, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
I20260807 10:46:18.821781 31580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.797003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:37347 (local address 127.0.0.1:42618)
0807 10:46:18.797263 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:18.797291 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:18.797488 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:18.798341 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:18.798346 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:18.798903 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:18.799153 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.799169 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.800724 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.800730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.802310 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:18.802334 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.803849 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.803856 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:18.804087 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.804872 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:18.804898 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:18.808096 (+ 3198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:18.817349 (+ 9253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.817356 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.817361 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.818015 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.818890 (+ 875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:18.818896 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:18.818900 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:18.819114 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:18.820529 (+ 1415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:18.820534 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:18.820742 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 10:46:18.820902 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 10:46:18.821247 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260807 10:46:18.822271 31806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:18.797558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42618 (local address 127.11.46.188:37347)
0807 10:46:18.797767 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:18.797773 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:18.797797 (+ 24us) server_negotiation.cc:407] Connection header received
0807 10:46:18.797871 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:18.797876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:18.797961 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:18.798069 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:18.799407 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.800499 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.802560 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:18.803575 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:18.803863 (+ 288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:18.808422 (+ 4559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:18.808431 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:18.808436 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:18.808503 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:18.817057 (+ 8554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.818218 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.818260 (+ 42us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.818265 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.818690 (+ 425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:18.819270 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:18.819276 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:18.819279 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:18.820305 (+ 1026us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:18.820756 (+ 451us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:18.821262 (+ 506us) server_negotiation.cc:299] Negotiation successful
0807 10:46:18.821843 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 10:46:18.829104 31578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8: Bootstrap starting.
I20260807 10:46:18.833320 31766 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [term 1 FOLLOWER]: Refusing update from remote peer c8257e9fd7534946bb6156e4e1696d67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:46:18.834842 31578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:18.835179 31861 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:46:18.837476 31578 log.cc:824] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:18.862916 31823 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8257e9fd7534946bb6156e4e1696d67. Latest consensus state: current_term: 1 leader_uuid: "c8257e9fd7534946bb6156e4e1696d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } } }
I20260807 10:46:18.863272 31823 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:46:18.869819 31871 mvcc.cc:205] Tried to move back new op lower bound from 7315863874865299456 to 7315863874702565376. Current Snapshot: MvccSnapshot[applied={T|T < 7315863874865299456}]
I20260807 10:46:18.877156 31578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8: No bootstrap required, opened a new log
I20260807 10:46:18.878105 31823 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c8257e9fd7534946bb6156e4e1696d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } } }
I20260807 10:46:18.878424 31823 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:46:18.883173 31861 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c8257e9fd7534946bb6156e4e1696d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } } }
I20260807 10:46:18.883563 31861 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:18.894804 31866 catalog_manager.cc:1347] Generated new cluster ID: a4b85c80a54a4ce28a98daf845090cd5
I20260807 10:46:18.894968 31866 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:46:18.910231 31578 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } }
I20260807 10:46:18.911118 31578 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:18.911345 31578 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2bf73cddf4d42e9baf135bc5f60a2f8, State: Initialized, Role: FOLLOWER
I20260807 10:46:18.912647 31578 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } }
I20260807 10:46:18.925911 31875 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } } }
I20260807 10:46:18.926563 31875 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:46:18.930750 31545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8257e9fd7534946bb6156e4e1696d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8"
I20260807 10:46:18.931239 31544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:18.931690 31546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8257e9fd7534946bb6156e4e1696d67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" is_pre_election: true
I20260807 10:46:18.932241 31578 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:46:18.935770 31544 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [term 1 FOLLOWER]: Refusing update from remote peer c8257e9fd7534946bb6156e4e1696d67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 10:46:18.946537 31892 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:46:18.946712 31892 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:46:18.948374 31866 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:46:18.948410 31861 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260807 10:46:18.982911 31866 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:46:19.000535 31875 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8257e9fd7534946bb6156e4e1696d67. Latest consensus state: current_term: 1 leader_uuid: "c8257e9fd7534946bb6156e4e1696d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } } }
I20260807 10:46:19.000911 31875 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:46:19.002815 31842 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c8257e9fd7534946bb6156e4e1696d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } } }
I20260807 10:46:19.003106 31842 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67 [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:19.004074 31897 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c8257e9fd7534946bb6156e4e1696d67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2bf73cddf4d42e9baf135bc5f60a2f8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40081 } } peers { permanent_uuid: "c8257e9fd7534946bb6156e4e1696d67" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 45485 } } peers { permanent_uuid: "dbacfdc997674b4f876a7b56deab00d5" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 37347 } } }
I20260807 10:46:19.004537 31897 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:46:19.015463 31866 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8257e9fd7534946bb6156e4e1696d67: Generated new TSK 0
I20260807 10:46:19.016845 31866 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:46:19.703727 31838 catalog_manager.cc:1259] Loaded cluster ID: a4b85c80a54a4ce28a98daf845090cd5
I20260807 10:46:19.703886 31838 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5: loading cluster ID for follower catalog manager: success
I20260807 10:46:19.706746 31838 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5: acquiring CA information for follower catalog manager: success
I20260807 10:46:19.708907 31838 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dbacfdc997674b4f876a7b56deab00d5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:46:19.949035 31892 catalog_manager.cc:1259] Loaded cluster ID: a4b85c80a54a4ce28a98daf845090cd5
I20260807 10:46:19.949165 31892 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8: loading cluster ID for follower catalog manager: success
I20260807 10:46:19.952363 31892 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8: acquiring CA information for follower catalog manager: success
I20260807 10:46:19.954838 31892 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e2bf73cddf4d42e9baf135bc5f60a2f8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:46:20.148381 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 31484
I20260807 10:46:20.150069 31571 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:20.263029 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 31484
I20260807 10:46:20.299435 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 31589
I20260807 10:46:20.300655 31683 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:20.419405 31912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:20.418604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40081 (local address 127.0.0.1:42190)
0807 10:46:20.419061 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:20.419167 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:40081: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":223,"threads_started":1}
I20260807 10:46:20.419413 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 31589
I20260807 10:46:20.455607 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 31702
I20260807 10:46:20.456800 31794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:20.572906 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 31702
2026-08-07T10:46:20Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5337 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:46:20 dist-test-slave-42z9 krb5kdc[31917](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:46:20 dist-test-slave-42z9 krb5kdc[31917](info): set up 2 sockets
Aug 07 10:46:20 dist-test-slave-42z9 krb5kdc[31917](info): commencing operation
krb5kdc: starting...
W20260807 10:46:21.840055 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.003s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:46:22 dist-test-slave-42z9 krb5kdc[31917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:46:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:46:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:46:22.193172 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36725
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:44893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:36725
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:22.581578 31932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:22.581949 31932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:22.582069 31932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:22.590035 31932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:46:22.590196 31932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:22.590263 31932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:22.590327 31932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:46:22.590373 31932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:46:22.601388 31932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:44893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:36725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:22.602952 31932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:22.604429 31932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:22.617911 31939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:22.617942 31944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:22.617871 31950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:22.619248 31932 server_base.cc:1034] running on GCE node
I20260807 10:46:22.620158 31932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:22.621865 31932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:22.623091 31932 hybrid_clock.cc:648] HybridClock initialized: now 1786099582623037 us; error 43 us; skew 500 ppm
I20260807 10:46:22.623492 31932 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:22 dist-test-slave-42z9 krb5kdc[31917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099582, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:22.631644 31932 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:46:22.633638 31932 webserver.cc:460] Webserver started at http://127.11.46.190:39685/ using document root <none> and password file <none>
I20260807 10:46:22.634492 31932 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:22.634655 31932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:22.635008 31932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:22.638619 31932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "4f19462eeb404f76afc753fac6da49a9"
format_stamp: "Formatted at 2026-08-07 10:46:22 on dist-test-slave-42z9"
server_key: "4e4665a3a5d1431b9dc3cc1964e703b8"
server_key_iv: "ecbfbcefe3c011150669e7cf98b77e89"
server_key_version: "encryptionkey@0"
I20260807 10:46:22.639529 31932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "4f19462eeb404f76afc753fac6da49a9"
format_stamp: "Formatted at 2026-08-07 10:46:22 on dist-test-slave-42z9"
server_key: "4e4665a3a5d1431b9dc3cc1964e703b8"
server_key_iv: "ecbfbcefe3c011150669e7cf98b77e89"
server_key_version: "encryptionkey@0"
I20260807 10:46:22.645889 31932 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:46:22.650218 31958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:22.651892 31932 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:46:22.652120 31932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "4f19462eeb404f76afc753fac6da49a9"
format_stamp: "Formatted at 2026-08-07 10:46:22 on dist-test-slave-42z9"
server_key: "4e4665a3a5d1431b9dc3cc1964e703b8"
server_key_iv: "ecbfbcefe3c011150669e7cf98b77e89"
server_key_version: "encryptionkey@0"
I20260807 10:46:22.652354 31932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:22.688768 31932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:22.694017 31932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:22.694343 31932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:22.715212 31932 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:36725
I20260807 10:46:22.715219 32025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:36725 every 8 connection(s)
I20260807 10:46:22.716984 31932 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:46:22.721640 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 31932
I20260807 10:46:22.721906 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:46:22.721968 32026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:22.722841 11450 external_mini_cluster.cc:1428] Setting key 646c4f898ffb6931b7e9e6334ecd2992
I20260807 10:46:22.739374 32026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9: Bootstrap starting.
Aug 07 10:46:22 dist-test-slave-42z9 krb5kdc[31917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:22.743345 32026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:22.744596 32026 log.cc:824] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:22.747848 32026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9: No bootstrap required, opened a new log
I20260807 10:46:22.749177 32031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:22.725148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44010 (local address 127.11.46.190:36725)
0807 10:46:22.726083 (+ 935us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:22.726097 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:22.726154 (+ 57us) server_negotiation.cc:407] Connection header received
0807 10:46:22.727862 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:22.727891 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:22.728411 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:22.728851 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:22.730945 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:22.732442 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:22.734560 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:22.735447 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:22.735623 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:22.741122 (+ 5499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:22.741135 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:22.741158 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:22.741215 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:22.744505 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:22.745487 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:22.745497 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:22.745505 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:22.745721 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:22.746149 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:22.746154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:22.746156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:22.746757 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:22.747079 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:22.747589 (+ 510us) server_negotiation.cc:299] Negotiation successful
0807 10:46:22.748114 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":686,"thread_start_us":442,"threads_started":1}
I20260807 10:46:22.753183 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:46:22.756323 32026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19462eeb404f76afc753fac6da49a9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36725 } }
I20260807 10:46:22.756803 32026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:22.756910 32026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f19462eeb404f76afc753fac6da49a9, State: Initialized, Role: FOLLOWER
I20260807 10:46:22.757512 32026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19462eeb404f76afc753fac6da49a9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36725 } }
I20260807 10:46:22.757802 32026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:46:22.757941 32026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:46:22.758081 32026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:22.760301 32026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19462eeb404f76afc753fac6da49a9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36725 } }
I20260807 10:46:22.760783 32026 leader_election.cc:302] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f19462eeb404f76afc753fac6da49a9; no voters:
I20260807 10:46:22.761368 32026 leader_election.cc:288] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:46:22.761531 32033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:46:22.762197 32033 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [term 1 LEADER]: Becoming Leader. State: Replica: 4f19462eeb404f76afc753fac6da49a9, State: Running, Role: LEADER
I20260807 10:46:22.762740 32033 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19462eeb404f76afc753fac6da49a9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36725 } }
I20260807 10:46:22.763551 32026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:46:22.765327 32034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f19462eeb404f76afc753fac6da49a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19462eeb404f76afc753fac6da49a9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36725 } } }
I20260807 10:46:22.765741 32034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:22.765651 32035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f19462eeb404f76afc753fac6da49a9. Latest consensus state: current_term: 1 leader_uuid: "4f19462eeb404f76afc753fac6da49a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f19462eeb404f76afc753fac6da49a9" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36725 } } }
I20260807 10:46:22.765916 32035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9 [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:22.770119 32043 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:46:22.774959 32043 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:46:22.784220 32043 catalog_manager.cc:1347] Generated new cluster ID: 74d731beadc34411a083aec6c7650e9c
I20260807 10:46:22.784346 32043 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:46:22.805076 32043 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:46:22.806535 32043 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:46:22.819649 32043 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f19462eeb404f76afc753fac6da49a9: Generated new TSK 0
I20260807 10:46:22.821429 32043 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:46:22.867676 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 31932
I20260807 10:46:22.869200 32020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:22.968990 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 31932
2026-08-07T10:46:22Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2384 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:46:23 dist-test-slave-42z9 krb5kdc[32068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:46:23 dist-test-slave-42z9 krb5kdc[32068](info): set up 2 sockets
Aug 07 10:46:23 dist-test-slave-42z9 krb5kdc[32068](info): commencing operation
krb5kdc: starting...
W20260807 10:46:24.215440 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.003s sys 0.055s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:46:24 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:46:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:46:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:46:24.563009 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:44679
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:44679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:24.948838 32085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:24.949225 32085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:24.949323 32085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:24.957039 32085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:46:24.957182 32085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:24.957242 32085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:24.957304 32085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:46:24.957351 32085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:46:24.968283 32085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:44679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:44679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:24.969810 32085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:24.971239 32085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:24.983994 32096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:24.983982 32097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:24.983978 32099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:24.985126 32085 server_base.cc:1034] running on GCE node
I20260807 10:46:24.986083 32085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:24.987716 32085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:24.988945 32085 hybrid_clock.cc:648] HybridClock initialized: now 1786099584988888 us; error 45 us; skew 500 ppm
I20260807 10:46:24.989316 32085 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:24 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099584, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:24.992744 32085 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:46:24.994581 32085 webserver.cc:460] Webserver started at http://127.11.46.190:37831/ using document root <none> and password file <none>
I20260807 10:46:24.995398 32085 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:24.995538 32085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:24.995870 32085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:24.999365 32085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "b6daf01e69034d579b13622bf43f293f"
format_stamp: "Formatted at 2026-08-07 10:46:24 on dist-test-slave-42z9"
server_key: "4f0ceff794fc78bd299edaf1c1bf127f"
server_key_iv: "66559d04a67bc6019286307cf56a49d8"
server_key_version: "encryptionkey@0"
I20260807 10:46:25.000241 32085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "b6daf01e69034d579b13622bf43f293f"
format_stamp: "Formatted at 2026-08-07 10:46:24 on dist-test-slave-42z9"
server_key: "4f0ceff794fc78bd299edaf1c1bf127f"
server_key_iv: "66559d04a67bc6019286307cf56a49d8"
server_key_version: "encryptionkey@0"
I20260807 10:46:25.006363 32085 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:46:25.010537 32109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:25.012166 32085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:46:25.012395 32085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "b6daf01e69034d579b13622bf43f293f"
format_stamp: "Formatted at 2026-08-07 10:46:24 on dist-test-slave-42z9"
server_key: "4f0ceff794fc78bd299edaf1c1bf127f"
server_key_iv: "66559d04a67bc6019286307cf56a49d8"
server_key_version: "encryptionkey@0"
I20260807 10:46:25.012624 32085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:25.027529 32085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:25.032176 32085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:25.032509 32085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:25.052594 32085 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:44679
I20260807 10:46:25.052603 32177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:44679 every 8 connection(s)
I20260807 10:46:25.054242 32085 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:46:25.058873 32178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:25.058904 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 32085
I20260807 10:46:25.059118 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:46:25.059852 11450 external_mini_cluster.cc:1428] Setting key 6526c5ddbed6529703b4f0dbeb953855
I20260807 10:46:25.073850 32178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Bootstrap starting.
Aug 07 10:46:25 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:25.077812 32178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:25.079234 32178 log.cc:824] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:25.083411 32178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: No bootstrap required, opened a new log
I20260807 10:46:25.086808 32181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:25.062153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41052 (local address 127.11.46.190:44679)
0807 10:46:25.063207 (+ 1054us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:25.063221 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:25.063274 (+ 53us) server_negotiation.cc:407] Connection header received
0807 10:46:25.065986 (+ 2712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:25.066023 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:25.066636 (+ 613us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:25.067116 (+ 480us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:25.068919 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:25.070513 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:25.072055 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:25.072877 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:25.073086 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:25.077869 (+ 4783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:25.077880 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:25.077905 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:25.077972 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:25.081810 (+ 3838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:25.082923 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:25.082930 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:25.082937 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:25.083145 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:25.083627 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:25.083631 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:25.083633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:25.084276 (+ 643us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:25.084568 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:25.085067 (+ 499us) server_negotiation.cc:299] Negotiation successful
0807 10:46:25.085523 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":775,"thread_start_us":457,"threads_started":1}
I20260807 10:46:25.093050 32178 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:25.093619 32178 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:25.093762 32178 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6daf01e69034d579b13622bf43f293f, State: Initialized, Role: FOLLOWER
I20260807 10:46:25.094499 32178 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:25.094769 32178 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:46:25.094902 32178 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:46:25.095081 32178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:25.097568 32178 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:25.098189 32178 leader_election.cc:302] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6daf01e69034d579b13622bf43f293f; no voters:
I20260807 10:46:25.098842 32178 leader_election.cc:288] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:46:25.099007 32186 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:46:25.099771 32186 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 1 LEADER]: Becoming Leader. State: Replica: b6daf01e69034d579b13622bf43f293f, State: Running, Role: LEADER
I20260807 10:46:25.100347 32186 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:25.101086 32178 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:46:25.103609 32188 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6daf01e69034d579b13622bf43f293f. Latest consensus state: current_term: 1 leader_uuid: "b6daf01e69034d579b13622bf43f293f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } } }
I20260807 10:46:25.103796 32187 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6daf01e69034d579b13622bf43f293f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } } }
I20260807 10:46:25.104140 32188 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:25.104264 32187 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:25.106631 32194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:46:25.111974 32194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:46:25.122203 32194 catalog_manager.cc:1347] Generated new cluster ID: 959caf4135a94acbb31238cc522935a1
I20260807 10:46:25.122355 32194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:46:25.146373 32194 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:46:25.148470 32194 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:46:25.169260 32194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Generated new TSK 0
I20260807 10:46:25.170347 32194 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:46:25.273743 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44679
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:25.696077 32218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:25.696430 32218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:25.696573 32218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:25.704481 32218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:25.704627 32218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:25.704782 32218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:46:25.715458 32218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:25.717005 32218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:25.718569 32218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:25.733078 32227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:25.733012 32228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:25.733042 32230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:25.734216 32218 server_base.cc:1034] running on GCE node
I20260807 10:46:25.734894 32218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:25.735972 32218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:25.737164 32218 hybrid_clock.cc:648] HybridClock initialized: now 1786099585737107 us; error 45 us; skew 500 ppm
I20260807 10:46:25.737553 32218 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:25 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:25.741107 32218 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:46:25.742966 32218 webserver.cc:460] Webserver started at http://127.11.46.129:35841/ using document root <none> and password file <none>
I20260807 10:46:25.743794 32218 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:25.743934 32218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:25.744283 32218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:25.747795 32218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e"
format_stamp: "Formatted at 2026-08-07 10:46:25 on dist-test-slave-42z9"
server_key: "21c33bc7c10bc4bf9a5c54c0213eaecf"
server_key_iv: "653862d7906be0f0f9a6a0dd5d482452"
server_key_version: "encryptionkey@0"
I20260807 10:46:25.748807 32218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e"
format_stamp: "Formatted at 2026-08-07 10:46:25 on dist-test-slave-42z9"
server_key: "21c33bc7c10bc4bf9a5c54c0213eaecf"
server_key_iv: "653862d7906be0f0f9a6a0dd5d482452"
server_key_version: "encryptionkey@0"
I20260807 10:46:25.755328 32218 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 10:46:25.759604 32243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:25.761183 32218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:46:25.761390 32218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e"
format_stamp: "Formatted at 2026-08-07 10:46:25 on dist-test-slave-42z9"
server_key: "21c33bc7c10bc4bf9a5c54c0213eaecf"
server_key_iv: "653862d7906be0f0f9a6a0dd5d482452"
server_key_version: "encryptionkey@0"
I20260807 10:46:25.761731 32218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:25.790021 32218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:25.794651 32218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:25.794966 32218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:25.796082 32218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:25.797715 32218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:25.797798 32218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:25.797946 32218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:25.798024 32218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:25.831152 32218 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:45703
I20260807 10:46:25.831190 32400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:45703 every 8 connection(s)
I20260807 10:46:25.832556 32218 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:46:25.838279 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 32218
I20260807 10:46:25.838503 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:46:25.839179 11450 external_mini_cluster.cc:1428] Setting key 0be911edeb21ee95b0767eea0b1484e5
Aug 07 10:46:25 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:25.856248 32404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:25.835364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:35063 (local address 127.11.46.190:44679)
0807 10:46:25.835881 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:25.835886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:25.837032 (+ 1146us) server_negotiation.cc:407] Connection header received
0807 10:46:25.839146 (+ 2114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:25.839153 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:25.839246 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:25.839378 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:25.841484 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:25.842249 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:25.844653 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:25.845124 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:25.845247 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:25.849904 (+ 4657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:25.849910 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:25.849914 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:25.849958 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:25.852553 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:25.853465 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:25.853472 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:25.853476 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:25.853633 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:25.854272 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:25.854277 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:25.854279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:25.854595 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:25.854748 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:25.855577 (+ 829us) server_negotiation.cc:299] Negotiation successful
0807 10:46:25.855855 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":267,"threads_started":1}
I20260807 10:46:25.857402 32405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:25.836007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:35063)
0807 10:46:25.836829 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:25.836874 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:25.838816 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:25.839725 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:25.839738 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:25.840389 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:25.841259 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:25.841284 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:25.842442 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:25.842447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:25.844408 (+ 1961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:25.844439 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:25.845429 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:25.845478 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:25.845800 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:25.846678 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:25.846711 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:25.849587 (+ 2876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:25.852748 (+ 3161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:25.852758 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:25.852775 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:25.853295 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:25.853763 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:25.853767 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:25.853770 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:25.854106 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:25.854740 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:25.854750 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:25.855143 (+ 393us) client_negotiation.cc:769] Sending connection context
0807 10:46:25.855431 (+ 288us) client_negotiation.cc:240] Negotiation successful
0807 10:46:25.856077 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":320,"threads_started":1}
I20260807 10:46:25.859668 32401 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44679
I20260807 10:46:25.860036 32401 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:25.860913 32401 heartbeater.cc:511] Master 127.11.46.190:44679 requested a full tablet report, sending...
I20260807 10:46:25.863817 32134 ts_manager.cc:194] Registered new tserver with Master: aa5bc4d1f3894277ae0f1c80a63ecd1e (127.11.46.129:45703)
I20260807 10:46:25.866041 32134 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:35063
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:46:25.916867 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44679
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:26.335775 32408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:26.336099 32408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:26.336200 32408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:26.343951 32408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:26.344094 32408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:26.344226 32408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:46:26.354777 32408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:26.356323 32408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:26.357800 32408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:26.373224 32418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:26.373222 32419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:26.373167 32421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:26.374274 32408 server_base.cc:1034] running on GCE node
I20260807 10:46:26.375054 32408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:26.376233 32408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:26.377485 32408 hybrid_clock.cc:648] HybridClock initialized: now 1786099586377401 us; error 50 us; skew 500 ppm
I20260807 10:46:26.377879 32408 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:26 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099586, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:26.381425 32408 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:46:26.383176 32408 webserver.cc:460] Webserver started at http://127.11.46.130:43649/ using document root <none> and password file <none>
I20260807 10:46:26.383961 32408 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:26.384086 32408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:26.384388 32408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:26.387943 32408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "e89fef2506824aaaaad20be8fd13b4f2"
format_stamp: "Formatted at 2026-08-07 10:46:26 on dist-test-slave-42z9"
server_key: "75131adf5b197efcbaa44fad05bc9403"
server_key_iv: "3f1351a8d0a56a7bc6fb5a5c78fe165b"
server_key_version: "encryptionkey@0"
I20260807 10:46:26.388916 32408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "e89fef2506824aaaaad20be8fd13b4f2"
format_stamp: "Formatted at 2026-08-07 10:46:26 on dist-test-slave-42z9"
server_key: "75131adf5b197efcbaa44fad05bc9403"
server_key_iv: "3f1351a8d0a56a7bc6fb5a5c78fe165b"
server_key_version: "encryptionkey@0"
I20260807 10:46:26.395344 32408 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.007s
I20260807 10:46:26.399928 32432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:26.401758 32408 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:46:26.401979 32408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "e89fef2506824aaaaad20be8fd13b4f2"
format_stamp: "Formatted at 2026-08-07 10:46:26 on dist-test-slave-42z9"
server_key: "75131adf5b197efcbaa44fad05bc9403"
server_key_iv: "3f1351a8d0a56a7bc6fb5a5c78fe165b"
server_key_version: "encryptionkey@0"
I20260807 10:46:26.402267 32408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:26.424556 32408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:26.429594 32408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:26.429936 32408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:26.431322 32408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:26.433204 32408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:26.433316 32408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:26.433483 32408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:26.433544 32408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 10:46:26.469609 32408 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:42469
I20260807 10:46:26.469653 32594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:42469 every 8 connection(s)
I20260807 10:46:26.471171 32408 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:46:26.478173 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 32408
I20260807 10:46:26.478364 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:46:26.478863 11450 external_mini_cluster.cc:1428] Setting key 5f3930f5713354d6908e65872f96be29
Aug 07 10:46:26 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099586, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:26.494613 32598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:26.474334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:43411 (local address 127.11.46.190:44679)
0807 10:46:26.474854 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:26.474858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:26.475925 (+ 1067us) server_negotiation.cc:407] Connection header received
0807 10:46:26.477993 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:26.477999 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:26.478095 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:26.478295 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:26.480272 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:26.481209 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:26.482981 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:26.483472 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:26.483608 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:26.487797 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:26.487802 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:26.487806 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:26.487845 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:26.490701 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:26.491704 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:26.491709 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:26.491711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:26.491870 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:26.492408 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:26.492412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:26.492414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:26.492764 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:26.492921 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:26.493891 (+ 970us) server_negotiation.cc:299] Negotiation successful
0807 10:46:26.494190 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":290,"threads_started":1}
I20260807 10:46:26.495813 32599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:26.474901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:43411)
0807 10:46:26.475734 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:26.475788 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:26.477665 (+ 1877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:26.478608 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:26.478617 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:26.479269 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:26.480062 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:26.480092 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:26.481394 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:26.481398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:26.482807 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:26.482824 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:26.483765 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:26.483775 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:26.484060 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:26.484836 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:26.484868 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:26.487493 (+ 2625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:26.490930 (+ 3437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:26.490940 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:26.490959 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:26.491535 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:26.492001 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:26.492007 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:26.492011 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:26.492268 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:26.492918 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:26.492929 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:26.493387 (+ 458us) client_negotiation.cc:769] Sending connection context
0807 10:46:26.493750 (+ 363us) client_negotiation.cc:240] Negotiation successful
0807 10:46:26.494447 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":314,"threads_started":1}
I20260807 10:46:26.497622 32596 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44679
I20260807 10:46:26.497978 32596 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:26.498831 32596 heartbeater.cc:511] Master 127.11.46.190:44679 requested a full tablet report, sending...
I20260807 10:46:26.500697 32134 ts_manager.cc:194] Registered new tserver with Master: e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469)
I20260807 10:46:26.501899 32134 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:43411
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:46:26.555996 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44679
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:46:26.869937 32401 heartbeater.cc:503] Master 127.11.46.190:44679 was elected leader, sending a full tablet report...
W20260807 10:46:26.955111 32605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:26.955458 32605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:26.955597 32605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:26.963461 32605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:26.963630 32605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:26.963789 32605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:46:26.974876 32605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:44679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:26.976459 32605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:26.978137 32605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:26.994076 32611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:26.994161 32612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:26.994045 32614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:27.000336 32605 server_base.cc:1034] running on GCE node
I20260807 10:46:27.001153 32605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:27.002360 32605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:27.003587 32605 hybrid_clock.cc:648] HybridClock initialized: now 1786099587003534 us; error 65 us; skew 500 ppm
I20260807 10:46:27.003984 32605 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:27 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:27.007855 32605 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:46:27.009672 32605 webserver.cc:460] Webserver started at http://127.11.46.131:40757/ using document root <none> and password file <none>
I20260807 10:46:27.010510 32605 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:27.010641 32605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:27.010995 32605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:27.014425 32605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "dd55452547104d37b9b5cf05c28118d3"
format_stamp: "Formatted at 2026-08-07 10:46:27 on dist-test-slave-42z9"
server_key: "74c67027246a28b275fd3b99e9afa54b"
server_key_iv: "7e0045c5a7cf2b4cb5de79e8375bddfe"
server_key_version: "encryptionkey@0"
I20260807 10:46:27.015344 32605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "dd55452547104d37b9b5cf05c28118d3"
format_stamp: "Formatted at 2026-08-07 10:46:27 on dist-test-slave-42z9"
server_key: "74c67027246a28b275fd3b99e9afa54b"
server_key_iv: "7e0045c5a7cf2b4cb5de79e8375bddfe"
server_key_version: "encryptionkey@0"
I20260807 10:46:27.021740 32605 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 10:46:27.025951 32622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:27.027688 32605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:46:27.027901 32605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "dd55452547104d37b9b5cf05c28118d3"
format_stamp: "Formatted at 2026-08-07 10:46:27 on dist-test-slave-42z9"
server_key: "74c67027246a28b275fd3b99e9afa54b"
server_key_iv: "7e0045c5a7cf2b4cb5de79e8375bddfe"
server_key_version: "encryptionkey@0"
I20260807 10:46:27.028142 32605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:27.045341 32605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:27.050076 32605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:27.050395 32605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:27.051577 32605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:27.053340 32605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:27.053428 32605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:27.053592 32605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:27.053649 32605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:27.089162 32605 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:39231
I20260807 10:46:27.089193 331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:39231 every 8 connection(s)
I20260807 10:46:27.090766 32605 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:46:27.097711 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 32605
I20260807 10:46:27.097934 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:46:27.098584 11450 external_mini_cluster.cc:1428] Setting key 5eec5a0d0e4002985fd711b3c3858f61
Aug 07 10:46:27 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:27.116483 337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.094850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:32899 (local address 127.11.46.190:44679)
0807 10:46:27.095445 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.095450 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.097060 (+ 1610us) server_negotiation.cc:407] Connection header received
0807 10:46:27.099928 (+ 2868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.099935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.100040 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.100145 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:27.102324 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.103155 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.104986 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.105468 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.105620 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.109829 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:27.109836 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:27.109839 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:27.109892 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:27.112467 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:27.113570 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:27.113577 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:27.113580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:27.113762 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:27.114367 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:27.114373 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:27.114376 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:27.114783 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:27.114931 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.115936 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.116153 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":321,"threads_started":1}
I20260807 10:46:27.117844 339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.095705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:32899)
0807 10:46:27.096816 (+ 1111us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.096890 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:27.099562 (+ 2672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:27.100491 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:27.100503 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:27.101179 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:27.102088 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.102123 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.103354 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.103360 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.104782 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.104800 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.105761 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.105769 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.106080 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.106918 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:27.106961 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:27.109514 (+ 2553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:27.112671 (+ 3157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:27.112682 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:27.112701 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:27.113366 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:27.113896 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:27.113901 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:27.113906 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:27.114206 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:27.114963 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:27.114974 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:27.115509 (+ 535us) client_negotiation.cc:769] Sending connection context
0807 10:46:27.115799 (+ 290us) client_negotiation.cc:240] Negotiation successful
0807 10:46:27.116350 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"thread_start_us":397,"threads_started":1}
I20260807 10:46:27.119514 333 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44679
I20260807 10:46:27.119894 333 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:27.120801 333 heartbeater.cc:511] Master 127.11.46.190:44679 requested a full tablet report, sending...
I20260807 10:46:27.122750 32134 ts_manager.cc:194] Registered new tserver with Master: dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231)
I20260807 10:46:27.123669 32134 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:32899
I20260807 10:46:27.128094 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:46:27.146848 337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.133122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41062 (local address 127.11.46.190:44679)
0807 10:46:27.133311 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.133321 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.133793 (+ 472us) server_negotiation.cc:407] Connection header received
0807 10:46:27.133988 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.133994 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.134094 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.134187 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:27.135677 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.136464 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.137979 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.138412 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.138536 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.141133 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:27.141140 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:27.141144 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:27.141189 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:27.143814 (+ 2625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:27.144613 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:27.144619 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:27.144622 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:27.144770 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:27.145178 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:27.145183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:27.145185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:27.145616 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:27.145866 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.146237 (+ 371us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.146504 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 10:46:27.151930 32134 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41062:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:46:27.161316 32134 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:46:27.189327 363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.178472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:48558)
0807 10:46:27.180637 (+ 2165us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.180654 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:27.180865 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:27.181606 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:27.181610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:27.181633 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:27.181905 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.181913 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.183642 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.183647 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.185521 (+ 1874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.185546 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.188126 (+ 2580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.188133 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.188367 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.188446 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 10:46:27.188598 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 10:46:27.188851 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2011,"mutex_wait_us":3,"thread_start_us":1810,"threads_started":1}
I20260807 10:46:27.189432 361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.178982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48558 (local address 127.11.46.129:45703)
0807 10:46:27.180098 (+ 1116us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.180107 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.180754 (+ 647us) server_negotiation.cc:407] Connection header received
0807 10:46:27.181050 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.181058 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.181253 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.181382 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:27.182080 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.183415 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.185775 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.187525 (+ 1750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.187688 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.187963 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.188834 (+ 871us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.189042 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":936,"thread_start_us":1800,"threads_started":1}
I20260807 10:46:27.190542 356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.176220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:42469 (local address 127.0.0.1:36146)
0807 10:46:27.177655 (+ 1435us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.177700 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:27.177918 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:27.178926 (+ 1008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:27.178935 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:27.178969 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:27.179530 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.179544 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.182558 (+ 3014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.182564 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.186868 (+ 4304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.186888 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.189640 (+ 2752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.189648 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.189836 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.189903 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 10:46:27.189994 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:46:27.190122 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1091,"mutex_wait_us":1507,"thread_start_us":1205,"threads_started":1}
I20260807 10:46:27.190927 359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.176324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36146 (local address 127.11.46.130:42469)
0807 10:46:27.177133 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.177143 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.178166 (+ 1023us) server_negotiation.cc:407] Connection header received
0807 10:46:27.178291 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.178299 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.178599 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.178814 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:27.180590 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.182381 (+ 1791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.187118 (+ 4737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.189335 (+ 2217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.189944 (+ 609us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.190212 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.190292 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.190439 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":427,"threads_started":1}
I20260807 10:46:27.191388 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.176242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:39231 (local address 127.0.0.1:53454)
0807 10:46:27.178940 (+ 2698us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.178962 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:27.179103 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:27.180065 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:27.180071 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:27.180108 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:27.180643 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.180658 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.182673 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.182678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.186459 (+ 3781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.186476 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.188501 (+ 2025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.188507 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.189847 (+ 1340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.190777 (+ 930us) client_negotiation.cc:769] Sending connection context
0807 10:46:27.190872 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 10:46:27.191025 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2554,"mutex_wait_us":1550,"thread_start_us":2379,"threads_started":1}
I20260807 10:46:27.191730 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.176853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53454 (local address 127.11.46.131:39231)
0807 10:46:27.178430 (+ 1577us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.178439 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.179132 (+ 693us) server_negotiation.cc:407] Connection header received
0807 10:46:27.179245 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.179255 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.179544 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.179750 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:27.180871 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.182527 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.186689 (+ 4162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.188253 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.188419 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.188685 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.190985 (+ 2300us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.191208 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1407,"thread_start_us":1228,"threads_started":1}
I20260807 10:46:27.194867 32306 tablet_service.cc:1467] Processing CreateTablet for tablet 3fe394fe37f24233bf204f7d1f8610b5 (DEFAULT_TABLE table=test-table [id=86d160c2527f42c6a08b42d5c9e5e793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:27.195245 32497 tablet_service.cc:1467] Processing CreateTablet for tablet 3fe394fe37f24233bf204f7d1f8610b5 (DEFAULT_TABLE table=test-table [id=86d160c2527f42c6a08b42d5c9e5e793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:27.195359 32695 tablet_service.cc:1467] Processing CreateTablet for tablet 3fe394fe37f24233bf204f7d1f8610b5 (DEFAULT_TABLE table=test-table [id=86d160c2527f42c6a08b42d5c9e5e793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:27.196717 32695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fe394fe37f24233bf204f7d1f8610b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:27.196746 32306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fe394fe37f24233bf204f7d1f8610b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:27.196746 32497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fe394fe37f24233bf204f7d1f8610b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:27.211545 364 tablet_bootstrap.cc:492] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: Bootstrap starting.
I20260807 10:46:27.215435 364 tablet_bootstrap.cc:654] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:27.216795 364 log.cc:824] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:27.219465 365 tablet_bootstrap.cc:492] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: Bootstrap starting.
I20260807 10:46:27.222402 366 tablet_bootstrap.cc:492] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: Bootstrap starting.
I20260807 10:46:27.223052 364 tablet_bootstrap.cc:492] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: No bootstrap required, opened a new log
I20260807 10:46:27.223453 364 ts_tablet_manager.cc:1397] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.011s
I20260807 10:46:27.224360 365 tablet_bootstrap.cc:654] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:27.225648 365 log.cc:824] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:27.226802 366 tablet_bootstrap.cc:654] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:27.228881 366 log.cc:824] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:27.229374 365 tablet_bootstrap.cc:492] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: No bootstrap required, opened a new log
I20260807 10:46:27.229854 365 ts_tablet_manager.cc:1397] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260807 10:46:27.235646 364 raft_consensus.cc:348] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } }
I20260807 10:46:27.236328 364 raft_consensus.cc:374] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:27.236487 364 raft_consensus.cc:729] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd55452547104d37b9b5cf05c28118d3, State: Initialized, Role: FOLLOWER
I20260807 10:46:27.237353 364 consensus_queue.cc:260] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } }
I20260807 10:46:27.238732 333 heartbeater.cc:503] Master 127.11.46.190:44679 was elected leader, sending a full tablet report...
I20260807 10:46:27.239296 364 ts_tablet_manager.cc:1428] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
I20260807 10:46:27.239791 365 raft_consensus.cc:348] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } }
I20260807 10:46:27.240170 366 tablet_bootstrap.cc:492] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: No bootstrap required, opened a new log
I20260807 10:46:27.240325 365 raft_consensus.cc:374] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:27.240458 365 raft_consensus.cc:729] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa5bc4d1f3894277ae0f1c80a63ecd1e, State: Initialized, Role: FOLLOWER
I20260807 10:46:27.240523 366 ts_tablet_manager.cc:1397] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.014s
I20260807 10:46:27.241206 365 consensus_queue.cc:260] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } }
I20260807 10:46:27.243793 365 ts_tablet_manager.cc:1428] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260807 10:46:27.250594 366 raft_consensus.cc:348] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } }
I20260807 10:46:27.251060 366 raft_consensus.cc:374] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:27.251147 366 raft_consensus.cc:729] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89fef2506824aaaaad20be8fd13b4f2, State: Initialized, Role: FOLLOWER
I20260807 10:46:27.251763 366 consensus_queue.cc:260] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } }
I20260807 10:46:27.253403 32596 heartbeater.cc:503] Master 127.11.46.190:44679 was elected leader, sending a full tablet report...
I20260807 10:46:27.253916 366 ts_tablet_manager.cc:1428] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: Time spent starting tablet: real 0.013s user 0.013s sys 0.002s
I20260807 10:46:27.271893 377 raft_consensus.cc:482] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:46:27.272233 377 raft_consensus.cc:504] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } }
I20260807 10:46:27.274327 377 leader_election.cc:288] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231), aa5bc4d1f3894277ae0f1c80a63ecd1e (127.11.46.129:45703)
I20260807 10:46:27.284206 361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.274998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:43109 (local address 127.11.46.129:45703)
0807 10:46:27.275181 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.275187 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.275895 (+ 708us) server_negotiation.cc:407] Connection header received
0807 10:46:27.276091 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.276097 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.276185 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.276291 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:27.277129 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.278308 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.281575 (+ 3267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.282896 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.283077 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.283156 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.283753 (+ 597us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.283919 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 10:46:27.284206 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.274754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:49759 (local address 127.11.46.131:39231)
0807 10:46:27.274979 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.274985 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.275883 (+ 898us) server_negotiation.cc:407] Connection header received
0807 10:46:27.276105 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.276109 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.276184 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.276294 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:27.277113 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.278308 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.281578 (+ 3270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.282876 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.283070 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.283156 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.283753 (+ 597us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.283912 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:46:27.284423 378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.274644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:39231 (local address 127.11.46.130:49759)
0807 10:46:27.275710 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.275736 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:27.275980 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:27.276324 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:27.276329 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:27.276380 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:27.276930 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.276948 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.278465 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.278471 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.281308 (+ 2837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.281332 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.283222 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.283227 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.283581 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.283611 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 10:46:27.283710 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 10:46:27.283913 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":891,"mutex_wait_us":228,"spinlock_wait_cycles":55552,"thread_start_us":609,"threads_started":1}
I20260807 10:46:27.284607 380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.274644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.11.46.130:43109)
0807 10:46:27.275765 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.275779 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:27.275933 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:27.276324 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:27.276329 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:27.276378 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:27.276960 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.276971 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.278469 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.278473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.281308 (+ 2835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:27.281332 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.283218 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.283226 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:27.283515 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.283596 (+ 81us) client_negotiation.cc:769] Sending connection context
0807 10:46:27.283711 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 10:46:27.283913 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1010,"mutex_wait_us":319,"spinlock_wait_cycles":23552,"thread_start_us":640,"threads_started":1}
I20260807 10:46:27.285614 32731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fe394fe37f24233bf204f7d1f8610b5" candidate_uuid: "e89fef2506824aaaaad20be8fd13b4f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd55452547104d37b9b5cf05c28118d3" is_pre_election: true
I20260807 10:46:27.285972 32339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fe394fe37f24233bf204f7d1f8610b5" candidate_uuid: "e89fef2506824aaaaad20be8fd13b4f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" is_pre_election: true
I20260807 10:46:27.286315 32731 raft_consensus.cc:2454] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89fef2506824aaaaad20be8fd13b4f2 in term 0.
I20260807 10:46:27.286576 32339 raft_consensus.cc:2454] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89fef2506824aaaaad20be8fd13b4f2 in term 0.
I20260807 10:46:27.287186 32434 leader_election.cc:302] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: aa5bc4d1f3894277ae0f1c80a63ecd1e, dd55452547104d37b9b5cf05c28118d3, e89fef2506824aaaaad20be8fd13b4f2; no voters:
I20260807 10:46:27.287719 377 raft_consensus.cc:2781] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:46:27.287881 377 raft_consensus.cc:482] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:46:27.287959 377 raft_consensus.cc:3037] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:27.290453 377 raft_consensus.cc:504] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } }
I20260807 10:46:27.291164 377 leader_election.cc:288] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [CANDIDATE]: Term 1 election: Requested vote from peers dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231), aa5bc4d1f3894277ae0f1c80a63ecd1e (127.11.46.129:45703)
I20260807 10:46:27.291869 32339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fe394fe37f24233bf204f7d1f8610b5" candidate_uuid: "e89fef2506824aaaaad20be8fd13b4f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e"
I20260807 10:46:27.291863 32731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fe394fe37f24233bf204f7d1f8610b5" candidate_uuid: "e89fef2506824aaaaad20be8fd13b4f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd55452547104d37b9b5cf05c28118d3"
I20260807 10:46:27.292126 32731 raft_consensus.cc:3037] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:27.292126 32339 raft_consensus.cc:3037] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:27.295696 32339 raft_consensus.cc:2454] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89fef2506824aaaaad20be8fd13b4f2 in term 1.
I20260807 10:46:27.295696 32731 raft_consensus.cc:2454] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89fef2506824aaaaad20be8fd13b4f2 in term 1.
I20260807 10:46:27.296336 32436 leader_election.cc:302] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: aa5bc4d1f3894277ae0f1c80a63ecd1e, dd55452547104d37b9b5cf05c28118d3, e89fef2506824aaaaad20be8fd13b4f2; no voters:
I20260807 10:46:27.296747 377 raft_consensus.cc:2781] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:46:27.297238 377 raft_consensus.cc:686] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 1 LEADER]: Becoming Leader. State: Replica: e89fef2506824aaaaad20be8fd13b4f2, State: Running, Role: LEADER
I20260807 10:46:27.297844 377 consensus_queue.cc:237] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } }
I20260807 10:46:27.302842 32132 catalog_manager.cc:5495] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130). New cstate: current_term: 1 leader_uuid: "e89fef2506824aaaaad20be8fd13b4f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } health_report { overall_health: UNKNOWN } } }
W20260807 10:46:27.335418 32402 tablet.cc:2369] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:46:27.343019 335 tablet.cc:2369] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:46:27.348608 359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.342526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36148 (local address 127.11.46.130:42469)
0807 10:46:27.342771 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.342777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.342801 (+ 24us) server_negotiation.cc:407] Connection header received
0807 10:46:27.343072 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.343076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.343170 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.343338 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:46:27.343805 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.344557 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.346144 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.346584 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.346695 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.347232 (+ 537us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:46:27.347833 (+ 601us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:46:27.347973 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.348167 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.348264 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 10:46:27.358428 32339 raft_consensus.cc:1261] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Refusing update from remote peer e89fef2506824aaaaad20be8fd13b4f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:46:27.358428 32731 raft_consensus.cc:1261] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3 [term 1 FOLLOWER]: Refusing update from remote peer e89fef2506824aaaaad20be8fd13b4f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:46:27.359650 381 consensus_queue.cc:1035] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:46:27.360059 377 consensus_queue.cc:1035] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:46:27.391270 32134 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:46:27.391673 32134 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:46:27.396471 32134 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Sending DeleteTablet for 3 replicas of tablet 3fe394fe37f24233bf204f7d1f8610b5
I20260807 10:46:27.397959 32497 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fe394fe37f24233bf204f7d1f8610b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:27 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:36146
I20260807 10:46:27.397959 32306 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fe394fe37f24233bf204f7d1f8610b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:27 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:48558
I20260807 10:46:27.398002 32695 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fe394fe37f24233bf204f7d1f8610b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:27 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:53454
I20260807 10:46:27.399672 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 32218
I20260807 10:46:27.413515 403 tablet_replica.cc:330] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: stopping tablet replica
I20260807 10:46:27.413808 399 tablet_replica.cc:330] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: stopping tablet replica
I20260807 10:46:27.414202 403 raft_consensus.cc:2229] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:46:27.414494 399 raft_consensus.cc:2229] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:46:27.414889 403 raft_consensus.cc:2258] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:27.415154 399 raft_consensus.cc:2258] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:27.415726 400 tablet_replica.cc:330] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: stopping tablet replica
I20260807 10:46:27.416328 400 raft_consensus.cc:2229] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:46:27.417281 400 raft_consensus.cc:2258] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:27.418974 403 ts_tablet_manager.cc:1905] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:27.419893 400 ts_tablet_manager.cc:1905] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:27.420418 399 ts_tablet_manager.cc:1905] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 10:46:27 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:46:27.428249 399 ts_tablet_manager.cc:1918] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:27.428288 400 ts_tablet_manager.cc:1918] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:27.428494 400 log.cc:1196] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/3fe394fe37f24233bf204f7d1f8610b5
I20260807 10:46:27.429138 400 ts_tablet_manager.cc:1939] T 3fe394fe37f24233bf204f7d1f8610b5 P e89fef2506824aaaaad20be8fd13b4f2: Deleting consensus metadata
I20260807 10:46:27.431517 32115 catalog_manager.cc:4841] TS e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469): tablet 3fe394fe37f24233bf204f7d1f8610b5 (table test-table [id=86d160c2527f42c6a08b42d5c9e5e793]) successfully deleted
I20260807 10:46:27.432269 361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.401409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48574 (local address 127.11.46.129:45703)
0807 10:46:27.401620 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.401627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.408034 (+ 6407us) server_negotiation.cc:407] Connection header received
0807 10:46:27.409219 (+ 1185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.409227 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.409389 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.409509 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:27.412901 (+ 3392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.414154 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.416138 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.416824 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.416936 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.423505 (+ 6569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:27.423527 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:27.423549 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:27.423610 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:27.427874 (+ 4264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:27.429123 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:27.429136 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:27.429139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:27.429354 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:27.429982 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:27.429988 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:27.429991 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:27.430572 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:27.430947 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.431621 (+ 674us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.431891 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:46:27.432655 399 log.cc:1196] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/3fe394fe37f24233bf204f7d1f8610b5
I20260807 10:46:27.433499 32394 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:27.437593 403 ts_tablet_manager.cc:1918] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:27.437815 403 log.cc:1196] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/3fe394fe37f24233bf204f7d1f8610b5
I20260807 10:46:27.438413 403 ts_tablet_manager.cc:1939] T 3fe394fe37f24233bf204f7d1f8610b5 P dd55452547104d37b9b5cf05c28118d3: Deleting consensus metadata
I20260807 10:46:27.440732 32112 catalog_manager.cc:4841] TS dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231): tablet 3fe394fe37f24233bf204f7d1f8610b5 (table test-table [id=86d160c2527f42c6a08b42d5c9e5e793]) successfully deleted
I20260807 10:46:27.525588 399 ts_tablet_manager.cc:1939] T 3fe394fe37f24233bf204f7d1f8610b5 P aa5bc4d1f3894277ae0f1c80a63ecd1e: Deleting consensus metadata
I20260807 10:46:27.526401 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 32218
W20260807 10:46:27.560855 32116 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.46.129:45703 (error 108)
I20260807 10:46:27.561059 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 32408
I20260807 10:46:27.565524 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.564772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:48588)
0807 10:46:27.565055 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.565244 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260807 10:46:27.566047 32116 catalog_manager.cc:4584] TS aa5bc4d1f3894277ae0f1c80a63ecd1e (127.11.46.129:45703): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3fe394fe37f24233bf204f7d1f8610b5: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Aug 07 10:46:27 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:46:27.587452 359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.562461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36158 (local address 127.11.46.130:42469)
0807 10:46:27.562720 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.562727 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.562945 (+ 218us) server_negotiation.cc:407] Connection header received
0807 10:46:27.563180 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.563188 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.563295 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.563460 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:27.565421 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.566660 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.568150 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.568674 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.568803 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.580186 (+ 11383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:27.580204 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:27.580224 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:27.580284 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:27.583962 (+ 3678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:27.585134 (+ 1172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:27.585143 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:27.585146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:27.585340 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:27.585818 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:27.585822 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:27.585824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:27.586265 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:27.586574 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.586887 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.587107 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 10:46:27.588227 32589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:27.619966 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.619400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:48598)
0807 10:46:27.619638 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.619755 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 10:46:27.621070 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.620688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:48604)
0807 10:46:27.620848 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.620931 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 10:46:27.681658 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.681081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:48608)
0807 10:46:27.681314 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.681409 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260807 10:46:27.682791 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.682393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:48614)
0807 10:46:27.682564 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.682648 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 10:46:27.714162 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 32408
I20260807 10:46:27.750829 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 32605
Aug 07 10:46:27 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:46:27.763525 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.762991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:48618)
0807 10:46:27.763256 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.763352 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260807 10:46:27.764643 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.764220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:48622)
0807 10:46:27.764433 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:27.764507 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260807 10:46:27.770570 360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:27.751668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53460 (local address 127.11.46.131:39231)
0807 10:46:27.751885 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:27.751891 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:27.751911 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:46:27.752078 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:27.752082 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:27.752155 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:27.752248 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:27.753573 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.754344 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.755843 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:27.756433 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:27.756615 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:27.764816 (+ 8201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:27.764842 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:27.764866 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:27.764936 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:27.767696 (+ 2760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:27.768515 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:27.768523 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:27.768525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:27.768685 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:27.769031 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:27.769034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:27.769036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:27.769470 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:27.769734 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:27.770074 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 10:46:27.770276 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 10:46:27.771330 327 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:27.863970 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 32605
I20260807 10:46:27.895177 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 32085
I20260807 10:46:27.896380 32171 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:28.013710 354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:28.013079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:48632)
0807 10:46:28.013307 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:28.013414 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 10:46:28.013875 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 32085
I20260807 10:46:28.050128 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:44679
--webserver_interface=127.11.46.190
--webserver_port=37831
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:44679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:28.440522 414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:28.440871 414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:28.440968 414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:28.448777 414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:46:28.448927 414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:28.448993 414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:28.449056 414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:46:28.449101 414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:46:28.460067 414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:44679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:44679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=37831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:28.461696 414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:28.463357 414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:28.493857 424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:28.493836 425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:28.493867 429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:28.494905 414 server_base.cc:1034] running on GCE node
I20260807 10:46:28.495924 414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:28.497932 414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:28.499209 414 hybrid_clock.cc:648] HybridClock initialized: now 1786099588499141 us; error 58 us; skew 500 ppm
I20260807 10:46:28.499711 414 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:28 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:28.503757 414 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:46:28.505880 414 webserver.cc:460] Webserver started at http://127.11.46.190:37831/ using document root <none> and password file <none>
I20260807 10:46:28.506814 414 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:28.507014 414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:28.514307 414 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260807 10:46:28.517887 439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:28.519582 414 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260807 10:46:28.519809 414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "b6daf01e69034d579b13622bf43f293f"
format_stamp: "Formatted at 2026-08-07 10:46:24 on dist-test-slave-42z9"
server_key: "4f0ceff794fc78bd299edaf1c1bf127f"
server_key_iv: "66559d04a67bc6019286307cf56a49d8"
server_key_version: "encryptionkey@0"
I20260807 10:46:28.521067 414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:28.562026 414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:28.566874 414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:28.567203 414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:28.587749 414 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:44679
I20260807 10:46:28.587769 518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:44679 every 8 connection(s)
I20260807 10:46:28.589609 414 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:46:28.597843 522 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:46:28.598213 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 414
I20260807 10:46:28.599277 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:45703
--local_ip_for_outbound_sockets=127.11.46.129
--tserver_master_addrs=127.11.46.190:44679
--webserver_port=35841
--webserver_interface=127.11.46.129
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:46:28.603277 522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Bootstrap starting.
I20260807 10:46:28.628595 522 log.cc:824] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:28.643399 522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:46:28.644030 522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Bootstrap complete.
I20260807 10:46:28.654146 522 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:28.655162 522 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6daf01e69034d579b13622bf43f293f, State: Initialized, Role: FOLLOWER
I20260807 10:46:28.655884 522 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:28.656165 522 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:46:28.656301 522 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:46:28.656477 522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:46:28.661024 522 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:28.661713 522 leader_election.cc:302] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6daf01e69034d579b13622bf43f293f; no voters:
I20260807 10:46:28.662398 522 leader_election.cc:288] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 10:46:28.662585 529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 2 FOLLOWER]: Leader election won for term 2
I20260807 10:46:28.663892 529 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 2 LEADER]: Becoming Leader. State: Replica: b6daf01e69034d579b13622bf43f293f, State: Running, Role: LEADER
I20260807 10:46:28.664672 529 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:28.665102 522 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:46:28.667719 534 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6daf01e69034d579b13622bf43f293f. Latest consensus state: current_term: 2 leader_uuid: "b6daf01e69034d579b13622bf43f293f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } } }
I20260807 10:46:28.668251 534 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:28.668928 533 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b6daf01e69034d579b13622bf43f293f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } } }
I20260807 10:46:28.669273 533 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:28.677670 543 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:46:28.687983 543 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:46:28.689867 543 catalog_manager.cc:1259] Loaded cluster ID: 959caf4135a94acbb31238cc522935a1
I20260807 10:46:28.690053 543 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:46:28.693811 543 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 10:46:28.712234 543 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 10:46:28.732015 543 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:46:28.734577 543 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Loaded TSK: 0
I20260807 10:46:28.736503 543 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 10:46:29.028795 525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:29.029136 525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:29.029273 525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:29.037950 525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:29.038093 525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:29.038254 525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:46:29.048987 525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:45703
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=35841
--tserver_master_addrs=127.11.46.190:44679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:29.050562 525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:29.052120 525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:29.068652 564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:29.068862 562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:29.069429 567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:29.069720 525 server_base.cc:1034] running on GCE node
I20260807 10:46:29.070425 525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:29.071616 525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:29.072897 525 hybrid_clock.cc:648] HybridClock initialized: now 1786099589072831 us; error 55 us; skew 500 ppm
I20260807 10:46:29.073259 525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:29 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099589, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:29.077000 525 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:46:29.078822 525 webserver.cc:460] Webserver started at http://127.11.46.129:35841/ using document root <none> and password file <none>
I20260807 10:46:29.079634 525 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:29.079778 525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:29.085973 525 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 10:46:29.089147 577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:29.090729 525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:46:29.090921 525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e"
format_stamp: "Formatted at 2026-08-07 10:46:25 on dist-test-slave-42z9"
server_key: "21c33bc7c10bc4bf9a5c54c0213eaecf"
server_key_iv: "653862d7906be0f0f9a6a0dd5d482452"
server_key_version: "encryptionkey@0"
I20260807 10:46:29.092024 525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:29.135159 525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:29.140115 525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:29.140416 525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:29.141587 525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:29.143196 525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:29.143308 525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:29.143428 525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:29.143503 525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:29.181649 525 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:45703
I20260807 10:46:29.181699 752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:45703 every 8 connection(s)
I20260807 10:46:29.183353 525 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:46:29.189368 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 525
I20260807 10:46:29.190088 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:42469
--local_ip_for_outbound_sockets=127.11.46.130
--tserver_master_addrs=127.11.46.190:44679
--webserver_port=43649
--webserver_interface=127.11.46.130
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:46:29 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099589, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:29.211701 756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:29.186590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:38575 (local address 127.11.46.190:44679)
0807 10:46:29.187264 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:29.187283 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:29.187987 (+ 704us) server_negotiation.cc:407] Connection header received
0807 10:46:29.190611 (+ 2624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:29.190631 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:29.191209 (+ 578us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:29.191713 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:29.193493 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:29.195370 (+ 1877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:29.197374 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:29.198458 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:29.198672 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:29.202854 (+ 4182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:29.202867 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:29.202893 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:29.202953 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:29.206414 (+ 3461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:29.207603 (+ 1189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:29.207611 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:29.207617 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:29.207821 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:29.208363 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:29.208366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:29.208369 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:29.208929 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:29.209088 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:29.210241 (+ 1153us) server_negotiation.cc:299] Negotiation successful
0807 10:46:29.210626 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":271,"threads_started":1}
I20260807 10:46:29.212009 757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:29.186901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:38575)
0807 10:46:29.187778 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:29.187826 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:29.189790 (+ 1964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:29.191880 (+ 2090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:29.191889 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:29.192491 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:29.193164 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:29.193187 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:29.195612 (+ 2425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:29.195616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:29.197183 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:29.197203 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:29.198717 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:29.198723 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:29.198956 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:29.199710 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:29.199739 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:29.202449 (+ 2710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:29.206660 (+ 4211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:29.206672 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:29.206694 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:29.207447 (+ 753us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:29.207972 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:29.207978 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:29.207981 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:29.208257 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:29.209102 (+ 845us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:29.209111 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:29.209695 (+ 584us) client_negotiation.cc:769] Sending connection context
0807 10:46:29.210029 (+ 334us) client_negotiation.cc:240] Negotiation successful
0807 10:46:29.210653 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":350,"threads_started":1}
I20260807 10:46:29.215694 754 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44679
I20260807 10:46:29.216063 754 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:29.216950 754 heartbeater.cc:511] Master 127.11.46.190:44679 requested a full tablet report, sending...
I20260807 10:46:29.219973 468 ts_manager.cc:194] Registered new tserver with Master: aa5bc4d1f3894277ae0f1c80a63ecd1e (127.11.46.129:45703)
I20260807 10:46:29.222285 468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:38575
W20260807 10:46:29.583092 758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:29.583427 758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:29.583556 758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:29.591360 758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:29.591514 758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:29.591679 758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:46:29.602708 758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:42469
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=43649
--tserver_master_addrs=127.11.46.190:44679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:29.604228 758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:29.605772 758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:29.620028 763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:29.620157 767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:29.620203 764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:29.620827 758 server_base.cc:1034] running on GCE node
I20260807 10:46:29.621635 758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:29.622756 758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:29.623987 758 hybrid_clock.cc:648] HybridClock initialized: now 1786099589623932 us; error 56 us; skew 500 ppm
I20260807 10:46:29.624346 758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:29 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099589, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:29.627884 758 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:46:29.629624 758 webserver.cc:460] Webserver started at http://127.11.46.130:43649/ using document root <none> and password file <none>
I20260807 10:46:29.630478 758 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:29.630615 758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:29.637141 758 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 10:46:29.640416 775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:29.642131 758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:46:29.642383 758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "e89fef2506824aaaaad20be8fd13b4f2"
format_stamp: "Formatted at 2026-08-07 10:46:26 on dist-test-slave-42z9"
server_key: "75131adf5b197efcbaa44fad05bc9403"
server_key_iv: "3f1351a8d0a56a7bc6fb5a5c78fe165b"
server_key_version: "encryptionkey@0"
I20260807 10:46:29.643522 758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:29.655581 758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:29.660070 758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:29.660393 758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:29.661553 758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:29.663069 758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:29.663172 758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:29.663297 758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:29.663390 758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:29.700379 758 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:42469
I20260807 10:46:29.700459 946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:42469 every 8 connection(s)
I20260807 10:46:29.702004 758 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:46:29.711402 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 758
I20260807 10:46:29.712046 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:39231
--local_ip_for_outbound_sockets=127.11.46.131
--tserver_master_addrs=127.11.46.190:44679
--webserver_port=40757
--webserver_interface=127.11.46.131
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:46:29 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099589, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:29.725046 756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:29.704782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:47125 (local address 127.11.46.190:44679)
0807 10:46:29.705013 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:29.705020 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:29.706352 (+ 1332us) server_negotiation.cc:407] Connection header received
0807 10:46:29.708269 (+ 1917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:29.708274 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:29.708373 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:29.708466 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:29.710129 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:29.710884 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:29.712804 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:29.713274 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:29.713415 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:29.717886 (+ 4471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:29.717894 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:29.717898 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:29.717944 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:29.720976 (+ 3032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:29.722189 (+ 1213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:29.722194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:29.722198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:29.722374 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:29.722942 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:29.722946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:29.722949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:29.723302 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:29.723446 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:29.724447 (+ 1001us) server_negotiation.cc:299] Negotiation successful
0807 10:46:29.724719 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:46:29.726855 949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:29.705330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:47125)
0807 10:46:29.706173 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:29.706223 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:29.707984 (+ 1761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:29.708690 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:29.708698 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:29.709255 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:29.709964 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:29.709984 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:29.711094 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:29.711098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:29.712610 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:29.712628 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:29.713584 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:29.713595 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:29.713848 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:29.714595 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:29.714654 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:29.717548 (+ 2894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:29.721218 (+ 3670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:29.721231 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:29.721256 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:29.722047 (+ 791us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:29.722499 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:29.722504 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:29.722508 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:29.722817 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:29.723456 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:29.723465 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:29.724001 (+ 536us) client_negotiation.cc:769] Sending connection context
0807 10:46:29.724343 (+ 342us) client_negotiation.cc:240] Negotiation successful
0807 10:46:29.725154 (+ 811us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":298,"threads_started":1}
I20260807 10:46:29.728727 947 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44679
I20260807 10:46:29.729135 947 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:29.730165 947 heartbeater.cc:511] Master 127.11.46.190:44679 requested a full tablet report, sending...
I20260807 10:46:29.732111 468 ts_manager.cc:194] Registered new tserver with Master: e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469)
I20260807 10:46:29.733002 468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:47125
W20260807 10:46:30.104910 952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:30.105413 952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:30.105628 952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:30.114642 952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:30.114826 952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:30.115005 952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:46:30.125870 952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:39231
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=40757
--tserver_master_addrs=127.11.46.190:44679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:30.129006 952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:30.132177 952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:30.148602 960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:30.148572 958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:30.148918 952 server_base.cc:1034] running on GCE node
W20260807 10:46:30.148936 963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:30.150116 952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:30.151288 952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:30.152536 952 hybrid_clock.cc:648] HybridClock initialized: now 1786099590152461 us; error 64 us; skew 500 ppm
I20260807 10:46:30.152915 952 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:30 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:30.156514 952 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:46:30.158381 952 webserver.cc:460] Webserver started at http://127.11.46.131:40757/ using document root <none> and password file <none>
I20260807 10:46:30.159214 952 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:30.159392 952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:30.166004 952 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:46:30.169364 976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:30.171113 952 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:46:30.171339 952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "dd55452547104d37b9b5cf05c28118d3"
format_stamp: "Formatted at 2026-08-07 10:46:27 on dist-test-slave-42z9"
server_key: "74c67027246a28b275fd3b99e9afa54b"
server_key_iv: "7e0045c5a7cf2b4cb5de79e8375bddfe"
server_key_version: "encryptionkey@0"
I20260807 10:46:30.172573 952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:30.206040 952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:30.211230 952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:30.211555 952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:30.212775 952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:30.214481 952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:30.214596 952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:30.214721 952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:30.214823 952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:30.226894 754 heartbeater.cc:503] Master 127.11.46.190:44679 was elected leader, sending a full tablet report...
I20260807 10:46:30.249708 952 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:39231
I20260807 10:46:30.249778 1137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:39231 every 8 connection(s)
I20260807 10:46:30.251308 952 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:46:30.253873 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 952
Aug 07 10:46:30 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:30.272960 1143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.255030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54534 (local address 127.11.46.190:44679)
0807 10:46:30.255621 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.255627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.258055 (+ 2428us) server_negotiation.cc:407] Connection header received
0807 10:46:30.258233 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.258238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.258329 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.258450 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:30.260324 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.261145 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.262567 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.263005 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.263122 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.266276 (+ 3154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:30.266281 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:30.266284 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:30.266321 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:30.269991 (+ 3670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:30.270857 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:30.270864 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:30.270867 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:30.271054 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:30.271443 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:30.271448 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:30.271451 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:30.271858 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:30.272161 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.272464 (+ 303us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.272668 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":276,"threads_started":1}
I20260807 10:46:30.276221 1142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.254232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:56275 (local address 127.11.46.190:44679)
0807 10:46:30.254777 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.254785 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.256391 (+ 1606us) server_negotiation.cc:407] Connection header received
0807 10:46:30.259003 (+ 2612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.259009 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.259095 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.259205 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:30.260936 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.261895 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.263615 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.264190 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.264308 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.268614 (+ 4306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:30.268623 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:30.268629 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:30.268699 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:30.272114 (+ 3415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:30.273492 (+ 1378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:30.273498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:30.273502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:30.273675 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:30.274218 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:30.274223 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:30.274226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:30.274596 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:30.274713 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.275561 (+ 848us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.275809 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":252,"threads_started":1}
I20260807 10:46:30.277395 1145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.254981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:56275)
0807 10:46:30.256122 (+ 1141us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.256199 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:30.258693 (+ 2494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:30.259463 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:30.259472 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:30.260041 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:30.260717 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.260739 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.262074 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.262078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.263451 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.263467 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.264458 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.264467 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.264718 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.265538 (+ 820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:30.265566 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:30.268262 (+ 2696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:30.272323 (+ 4061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:30.272336 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:30.272362 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:30.273332 (+ 970us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:30.273796 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:30.273799 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:30.273802 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:30.274099 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:30.274764 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:30.274772 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:30.275176 (+ 404us) client_negotiation.cc:769] Sending connection context
0807 10:46:30.275448 (+ 272us) client_negotiation.cc:240] Negotiation successful
0807 10:46:30.276079 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":478,"threads_started":1}
I20260807 10:46:30.278970 1138 heartbeater.cc:347] Connected to a master server at 127.11.46.190:44679
I20260807 10:46:30.279362 1138 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:30.280221 1138 heartbeater.cc:511] Master 127.11.46.190:44679 requested a full tablet report, sending...
I20260807 10:46:30.282018 468 ts_manager.cc:194] Registered new tserver with Master: dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231)
I20260807 10:46:30.282958 468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:56275
I20260807 10:46:30.288637 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:46:30.296167 1142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.289791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54538 (local address 127.11.46.190:44679)
0807 10:46:30.290003 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.290009 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.290406 (+ 397us) server_negotiation.cc:407] Connection header received
0807 10:46:30.290677 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.290681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.290842 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.290992 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:46:30.291452 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.292205 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.293742 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.294192 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.294331 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.294889 (+ 558us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:46:30.295516 (+ 627us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:46:30.295677 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.295798 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.295894 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:46:30.297324 468 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:54538:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:46:30.305323 468 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:46:30.345312 1156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.319957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:37406)
0807 10:46:30.335190 (+ 15233us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.335486 (+ 296us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:30.335747 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:30.336890 (+ 1143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:30.336896 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:30.336937 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:30.337540 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.337553 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.339722 (+ 2169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.339728 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.342509 (+ 2781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.342529 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.344094 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.344101 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.344323 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.344388 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 10:46:30.344560 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 10:46:30.344798 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14623,"mutex_wait_us":144,"spinlock_wait_cycles":3328,"thread_start_us":14429,"threads_started":1}
I20260807 10:46:30.345587 1159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.319989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:39231 (local address 127.0.0.1:56996)
0807 10:46:30.335715 (+ 15726us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.335740 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:30.335894 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:30.336896 (+ 1002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:30.336902 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:30.336981 (+ 79us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:30.337668 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.337684 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.339779 (+ 2095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.339783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.342282 (+ 2499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.342305 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.344592 (+ 2287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.344599 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.344792 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.344827 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 10:46:30.344910 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 10:46:30.345060 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15540,"mutex_wait_us":214,"spinlock_wait_cycles":3328,"thread_start_us":15512,"threads_started":1}
I20260807 10:46:30.345868 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.320759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40460 (local address 127.11.46.130:42469)
0807 10:46:30.333988 (+ 13229us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.333998 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.336077 (+ 2079us) server_negotiation.cc:407] Connection header received
0807 10:46:30.336213 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.336220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.336413 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.336611 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:30.337945 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.339951 (+ 2006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.342715 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.344212 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.344353 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.344563 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.345277 (+ 714us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.345516 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13022,"thread_start_us":13242,"threads_started":1}
I20260807 10:46:30.346431 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.319993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37406 (local address 127.11.46.129:45703)
0807 10:46:30.327304 (+ 7311us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.327315 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.335749 (+ 8434us) server_negotiation.cc:407] Connection header received
0807 10:46:30.336114 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.336123 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.336379 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.336589 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:30.337754 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.339548 (+ 1794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.342749 (+ 3201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.343834 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.344004 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.344296 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.345896 (+ 1600us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.346099 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7061,"thread_start_us":6857,"threads_started":1}
I20260807 10:46:30.346472 1161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.320702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56996 (local address 127.11.46.131:39231)
0807 10:46:30.333146 (+ 12444us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.333158 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.335954 (+ 2796us) server_negotiation.cc:407] Connection header received
0807 10:46:30.336105 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.336115 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.336384 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.336615 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:30.337928 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.339589 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.342487 (+ 2898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.344002 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.344153 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.344395 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.345911 (+ 1516us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.346120 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12162,"thread_start_us":11937,"threads_started":1}
I20260807 10:46:30.346503 1155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.320417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:42469 (local address 127.0.0.1:40460)
0807 10:46:30.335950 (+ 15533us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.335971 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:30.336086 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:30.336896 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:30.336902 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:30.336956 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:30.337757 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.337768 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.340137 (+ 2369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.340145 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.342510 (+ 2365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.342529 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.344718 (+ 2189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.344724 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.344875 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.344903 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 10:46:30.344972 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 10:46:30.345098 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15410,"mutex_wait_us":50,"spinlock_wait_cycles":6272,"thread_start_us":14093,"threads_started":1}
I20260807 10:46:30.350244 660 tablet_service.cc:1467] Processing CreateTablet for tablet fb8003018dff411387c64e53f0eeeb3c (DEFAULT_TABLE table=test-table [id=b8f57fba6ea2442da3c0a6b66f56e1c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:30.350247 849 tablet_service.cc:1467] Processing CreateTablet for tablet fb8003018dff411387c64e53f0eeeb3c (DEFAULT_TABLE table=test-table [id=b8f57fba6ea2442da3c0a6b66f56e1c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:30.351617 660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb8003018dff411387c64e53f0eeeb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:30.351646 849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb8003018dff411387c64e53f0eeeb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:30.353995 1044 tablet_service.cc:1467] Processing CreateTablet for tablet fb8003018dff411387c64e53f0eeeb3c (DEFAULT_TABLE table=test-table [id=b8f57fba6ea2442da3c0a6b66f56e1c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:30.355641 1044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb8003018dff411387c64e53f0eeeb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:30.365108 1162 tablet_bootstrap.cc:492] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Bootstrap starting.
I20260807 10:46:30.368304 1164 tablet_bootstrap.cc:492] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: Bootstrap starting.
I20260807 10:46:30.369272 1162 tablet_bootstrap.cc:654] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:30.370841 1162 log.cc:824] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:30.372162 1166 tablet_bootstrap.cc:492] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: Bootstrap starting.
I20260807 10:46:30.372578 1164 tablet_bootstrap.cc:654] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:30.374150 1164 log.cc:824] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:30.376628 1166 tablet_bootstrap.cc:654] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:30.376735 1162 tablet_bootstrap.cc:492] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: No bootstrap required, opened a new log
I20260807 10:46:30.377120 1162 ts_tablet_manager.cc:1397] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260807 10:46:30.377189 1164 tablet_bootstrap.cc:492] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: No bootstrap required, opened a new log
I20260807 10:46:30.377503 1164 ts_tablet_manager.cc:1397] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260807 10:46:30.378271 1166 log.cc:824] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:30.381947 1166 tablet_bootstrap.cc:492] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: No bootstrap required, opened a new log
I20260807 10:46:30.382328 1166 ts_tablet_manager.cc:1397] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260807 10:46:30.387280 1164 raft_consensus.cc:348] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:30.387925 1164 raft_consensus.cc:374] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:30.388051 1164 raft_consensus.cc:729] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89fef2506824aaaaad20be8fd13b4f2, State: Initialized, Role: FOLLOWER
I20260807 10:46:30.388053 1162 raft_consensus.cc:348] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:30.388566 1162 raft_consensus.cc:374] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:30.388685 1162 raft_consensus.cc:729] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa5bc4d1f3894277ae0f1c80a63ecd1e, State: Initialized, Role: FOLLOWER
I20260807 10:46:30.388827 1164 consensus_queue.cc:260] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:30.389329 1162 consensus_queue.cc:260] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:30.390383 947 heartbeater.cc:503] Master 127.11.46.190:44679 was elected leader, sending a full tablet report...
I20260807 10:46:30.390908 1164 ts_tablet_manager.cc:1428] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: Time spent starting tablet: real 0.013s user 0.007s sys 0.005s
I20260807 10:46:30.392472 1162 ts_tablet_manager.cc:1428] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Time spent starting tablet: real 0.015s user 0.007s sys 0.007s
I20260807 10:46:30.394639 1166 raft_consensus.cc:348] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:30.395238 1166 raft_consensus.cc:374] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:30.395356 1166 raft_consensus.cc:729] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd55452547104d37b9b5cf05c28118d3, State: Initialized, Role: FOLLOWER
I20260807 10:46:30.395985 1166 consensus_queue.cc:260] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:30.397957 1138 heartbeater.cc:503] Master 127.11.46.190:44679 was elected leader, sending a full tablet report...
I20260807 10:46:30.398427 1166 ts_tablet_manager.cc:1428] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: Time spent starting tablet: real 0.016s user 0.010s sys 0.004s
W20260807 10:46:30.436053 755 tablet.cc:2369] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:46:30.454237 948 tablet.cc:2369] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:46:30.503156 1140 tablet.cc:2369] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:46:30.567811 1175 raft_consensus.cc:482] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:46:30.568163 1175 raft_consensus.cc:504] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:30.570147 1175 leader_election.cc:288] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231), e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469)
I20260807 10:46:30.577931 1161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.570743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:36357 (local address 127.11.46.131:39231)
0807 10:46:30.571026 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.571033 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.571965 (+ 932us) server_negotiation.cc:407] Connection header received
0807 10:46:30.572139 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.572142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.572209 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.572305 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:30.572951 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.573881 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.575802 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.576774 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.576949 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.577034 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.577485 (+ 451us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.577639 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260807 10:46:30.577972 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.570752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:45689 (local address 127.11.46.130:42469)
0807 10:46:30.571015 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.571023 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.571869 (+ 846us) server_negotiation.cc:407] Connection header received
0807 10:46:30.572073 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.572079 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.572160 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.572231 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:30.572900 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.573728 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.575774 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.576775 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.576940 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.577035 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.577523 (+ 488us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.577682 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 10:46:30.578030 1177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.570796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:39231 (local address 127.11.46.129:36357)
0807 10:46:30.571831 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.571851 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:30.572000 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:30.572333 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:30.572338 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:30.572385 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:30.572755 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.572766 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.574057 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.574061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.575612 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.575627 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.577124 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.577132 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.577281 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.577309 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 10:46:30.577403 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 10:46:30.577657 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":921,"thread_start_us":519,"threads_started":1}
I20260807 10:46:30.578115 1178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.570778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:42469 (local address 127.11.46.129:45689)
0807 10:46:30.571735 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.571753 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:30.571910 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:30.572277 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:30.572282 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:30.572308 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:30.572743 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.572754 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.573869 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.573874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.575572 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:30.575590 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.577183 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.577188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:30.577330 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.577355 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 10:46:30.577470 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 10:46:30.577685 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":794,"mutex_wait_us":63,"thread_start_us":565,"threads_started":1}
I20260807 10:46:30.579315 874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8003018dff411387c64e53f0eeeb3c" candidate_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89fef2506824aaaaad20be8fd13b4f2" is_pre_election: true
I20260807 10:46:30.579331 1074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8003018dff411387c64e53f0eeeb3c" candidate_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd55452547104d37b9b5cf05c28118d3" is_pre_election: true
I20260807 10:46:30.579927 1074 raft_consensus.cc:2454] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa5bc4d1f3894277ae0f1c80a63ecd1e in term 0.
I20260807 10:46:30.579927 874 raft_consensus.cc:2454] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa5bc4d1f3894277ae0f1c80a63ecd1e in term 0.
I20260807 10:46:30.580704 581 leader_election.cc:302] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa5bc4d1f3894277ae0f1c80a63ecd1e, dd55452547104d37b9b5cf05c28118d3; no voters:
I20260807 10:46:30.581167 1175 raft_consensus.cc:2781] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:46:30.581329 1175 raft_consensus.cc:482] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:46:30.581431 1175 raft_consensus.cc:3037] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:30.583977 1175 raft_consensus.cc:504] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:30.584663 1175 leader_election.cc:288] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 1 election: Requested vote from peers dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231), e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469)
I20260807 10:46:30.585318 1074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8003018dff411387c64e53f0eeeb3c" candidate_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd55452547104d37b9b5cf05c28118d3"
I20260807 10:46:30.585309 874 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb8003018dff411387c64e53f0eeeb3c" candidate_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89fef2506824aaaaad20be8fd13b4f2"
I20260807 10:46:30.585569 874 raft_consensus.cc:3037] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:30.585574 1074 raft_consensus.cc:3037] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:30.588125 874 raft_consensus.cc:2454] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa5bc4d1f3894277ae0f1c80a63ecd1e in term 1.
I20260807 10:46:30.588470 1074 raft_consensus.cc:2454] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa5bc4d1f3894277ae0f1c80a63ecd1e in term 1.
I20260807 10:46:30.588726 583 leader_election.cc:302] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa5bc4d1f3894277ae0f1c80a63ecd1e, e89fef2506824aaaaad20be8fd13b4f2; no voters:
I20260807 10:46:30.589112 1175 raft_consensus.cc:2781] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:46:30.589641 1175 raft_consensus.cc:686] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 LEADER]: Becoming Leader. State: Replica: aa5bc4d1f3894277ae0f1c80a63ecd1e, State: Running, Role: LEADER
I20260807 10:46:30.590481 1175 consensus_queue.cc:237] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:30.595682 467 catalog_manager.cc:5495] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e reported cstate change: term changed from 0 to 1, leader changed from <none> to aa5bc4d1f3894277ae0f1c80a63ecd1e (127.11.46.129). New cstate: current_term: 1 leader_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } health_report { overall_health: UNKNOWN } } }
I20260807 10:46:30.632705 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.627267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37418 (local address 127.11.46.129:45703)
0807 10:46:30.627450 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.627455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.627476 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:46:30.627584 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.627588 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.627674 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.627811 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:46:30.628125 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.628880 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.630447 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.630917 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.631031 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.631553 (+ 522us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:46:30.632134 (+ 581us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:46:30.632259 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.632379 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.632467 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 10:46:30.642347 1074 raft_consensus.cc:1261] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3 [term 1 FOLLOWER]: Refusing update from remote peer aa5bc4d1f3894277ae0f1c80a63ecd1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:46:30.642349 874 raft_consensus.cc:1261] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2 [term 1 FOLLOWER]: Refusing update from remote peer aa5bc4d1f3894277ae0f1c80a63ecd1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:46:30.643468 1180 consensus_queue.cc:1035] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:46:30.643930 1175 consensus_queue.cc:1035] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:46:30.659039 1184 mvcc.cc:205] Tried to move back new op lower bound from 7315863923258933248 to 7315863923062808576. Current Snapshot: MvccSnapshot[applied={T|T < 7315863923258933248}]
I20260807 10:46:30.679109 468 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:54538:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:46:30.679494 468 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:54538:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:46:30.683828 468 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Sending DeleteTablet for 3 replicas of tablet fb8003018dff411387c64e53f0eeeb3c
I20260807 10:46:30.685375 1044 tablet_service.cc:1514] Processing DeleteTablet for tablet fb8003018dff411387c64e53f0eeeb3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:30 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:56996
I20260807 10:46:30.685389 660 tablet_service.cc:1514] Processing DeleteTablet for tablet fb8003018dff411387c64e53f0eeeb3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:30 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:37406
I20260807 10:46:30.685693 849 tablet_service.cc:1514] Processing DeleteTablet for tablet fb8003018dff411387c64e53f0eeeb3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:30 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:40460
I20260807 10:46:30.687145 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 525
I20260807 10:46:30.698261 1205 tablet_replica.cc:330] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: stopping tablet replica
I20260807 10:46:30.700953 1205 raft_consensus.cc:2229] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:46:30.701776 1205 raft_consensus.cc:2258] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:30.702455 1201 tablet_replica.cc:330] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: stopping tablet replica
I20260807 10:46:30.702955 1201 raft_consensus.cc:2229] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:46:30.703492 1201 raft_consensus.cc:2258] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:30.708428 1201 ts_tablet_manager.cc:1905] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:30.712864 1205 ts_tablet_manager.cc:1905] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:30.713692 1204 tablet_replica.cc:330] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: stopping tablet replica
I20260807 10:46:30.714233 1204 raft_consensus.cc:2229] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:46:30.715018 1204 raft_consensus.cc:2258] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:30.717150 1201 ts_tablet_manager.cc:1918] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:30.717396 1201 log.cc:1196] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/fb8003018dff411387c64e53f0eeeb3c
I20260807 10:46:30.718056 1201 ts_tablet_manager.cc:1939] T fb8003018dff411387c64e53f0eeeb3c P dd55452547104d37b9b5cf05c28118d3: Deleting consensus metadata
I20260807 10:46:30.719825 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.688092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37424 (local address 127.11.46.129:45703)
0807 10:46:30.688308 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.688316 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.688411 (+ 95us) server_negotiation.cc:407] Connection header received
0807 10:46:30.688618 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.688624 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.688743 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.688859 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:30.690786 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.692129 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.694202 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.695004 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.695139 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.706242 (+ 11103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:30.706268 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:30.706289 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:30.706353 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:30.712102 (+ 5749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:30.715764 (+ 3662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:30.715775 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:30.715778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:30.716026 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:30.716654 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:30.716658 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:30.716662 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:30.717236 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:30.718934 (+ 1698us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.719126 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.719438 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 10:46:30.720294 441 catalog_manager.cc:4841] TS dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231): tablet fb8003018dff411387c64e53f0eeeb3c (table test-table [id=b8f57fba6ea2442da3c0a6b66f56e1c3]) successfully deleted
I20260807 10:46:30.720933 748 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:30.726194 1205 ts_tablet_manager.cc:1918] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:30.726570 1205 log.cc:1196] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/fb8003018dff411387c64e53f0eeeb3c
I20260807 10:46:30.727311 1205 ts_tablet_manager.cc:1939] T fb8003018dff411387c64e53f0eeeb3c P e89fef2506824aaaaad20be8fd13b4f2: Deleting consensus metadata
I20260807 10:46:30.729606 443 catalog_manager.cc:4841] TS e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469): tablet fb8003018dff411387c64e53f0eeeb3c (table test-table [id=b8f57fba6ea2442da3c0a6b66f56e1c3]) successfully deleted
I20260807 10:46:30.722064 1204 ts_tablet_manager.cc:1905] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:30.825555 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 525
W20260807 10:46:30.853202 444 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.46.129:45703 (error 108)
I20260807 10:46:30.853387 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 758
I20260807 10:46:30.855284 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.854431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:37436)
0807 10:46:30.854911 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.855063 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":227,"threads_started":1}
W20260807 10:46:30.855531 444 catalog_manager.cc:4584] TS aa5bc4d1f3894277ae0f1c80a63ecd1e (127.11.46.129:45703): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fb8003018dff411387c64e53f0eeeb3c: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
I20260807 10:46:30.867811 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.854187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40466 (local address 127.11.46.130:42469)
0807 10:46:30.854391 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.854396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.854418 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:46:30.854492 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.854498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.854587 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.854703 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:30.856412 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.857210 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.858665 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.859088 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.859189 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:30.861888 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:30.861905 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:30.861925 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:30.861974 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:30.864745 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:30.865796 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:30.865805 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:30.865808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:30.865958 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:30.866306 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:30.866309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:30.866311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:30.866737 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:30.866974 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:30.867287 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 10:46:30.867476 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:46:30.868609 940 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:30.909152 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.908644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:37438)
0807 10:46:30.908868 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.908975 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260807 10:46:30.910375 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.909981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:37440)
0807 10:46:30.910139 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.910214 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 10:46:30.961928 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 758
I20260807 10:46:30.970993 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.970503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:37448)
0807 10:46:30.970733 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.970828 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 10:46:30.972177 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.971811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:37460)
0807 10:46:30.971948 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:30.972023 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 10:46:30.992338 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 952
I20260807 10:46:31.006285 1161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:30.993190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57012 (local address 127.11.46.131:39231)
0807 10:46:30.993402 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:30.993406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:30.993428 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:46:30.993579 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:30.993583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:30.993654 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:30.993742 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:30.995098 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.995851 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.997151 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:30.997815 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:30.997940 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:31.000697 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:31.000714 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:31.000732 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:31.000778 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:31.003524 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:31.004261 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:31.004269 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:31.004271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:31.004447 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:31.004801 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:31.004804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:31.004806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:31.005185 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:31.005424 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:31.005735 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 10:46:31.005933 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:46:31.007105 1130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:31.053022 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:31.052456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:37464)
0807 10:46:31.052716 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:31.052825 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260807 10:46:31.054255 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:31.053784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:37468)
0807 10:46:31.054011 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:31.054092 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260807 10:46:31.107014 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 952
I20260807 10:46:31.133926 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 414
I20260807 10:46:31.135195 513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:31.258653 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:31.258112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45703 (local address 127.0.0.1:37474)
0807 10:46:31.258329 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:31.258461 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 10:46:31.258808 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 414
I20260807 10:46:31.291034 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:44679
--webserver_interface=127.11.46.190
--webserver_port=37831
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:44679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:31.678795 1212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:31.679189 1212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:31.679359 1212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:31.687062 1212 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:46:31.687213 1212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:31.687304 1212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:31.687384 1212 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:46:31.687454 1212 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:46:31.698066 1212 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:44679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:44679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=37831
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:31.699615 1212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:31.701354 1212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:31.714660 1219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:31.714691 1222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:31.714740 1220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:31.716140 1212 server_base.cc:1034] running on GCE node
I20260807 10:46:31.717113 1212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:31.718911 1212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:31.720168 1212 hybrid_clock.cc:648] HybridClock initialized: now 1786099591720108 us; error 62 us; skew 500 ppm
I20260807 10:46:31.720577 1212 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:31 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099591, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:31.724068 1212 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:46:31.725864 1212 webserver.cc:460] Webserver started at http://127.11.46.190:37831/ using document root <none> and password file <none>
I20260807 10:46:31.726781 1212 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:31.726917 1212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:31.733978 1212 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 10:46:31.738150 1237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:31.739915 1212 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:46:31.740152 1212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "b6daf01e69034d579b13622bf43f293f"
format_stamp: "Formatted at 2026-08-07 10:46:24 on dist-test-slave-42z9"
server_key: "4f0ceff794fc78bd299edaf1c1bf127f"
server_key_iv: "66559d04a67bc6019286307cf56a49d8"
server_key_version: "encryptionkey@0"
I20260807 10:46:31.741340 1212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:31.767650 1212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:31.772327 1212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:31.772588 1212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:31.793329 1212 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:44679
I20260807 10:46:31.793349 1309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:44679 every 8 connection(s)
I20260807 10:46:31.795176 1212 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:46:31.798352 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 1212
I20260807 10:46:31.799288 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:45703
--local_ip_for_outbound_sockets=127.11.46.129
--tserver_master_addrs=127.11.46.190:44679
--webserver_port=35841
--webserver_interface=127.11.46.129
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:46:31.803479 1311 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:46:31.807353 1311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Bootstrap starting.
I20260807 10:46:31.834254 1311 log.cc:824] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:31.860167 1311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:46:31.860975 1311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f: Bootstrap complete.
I20260807 10:46:31.875253 1311 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:31.876647 1311 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6daf01e69034d579b13622bf43f293f, State: Initialized, Role: FOLLOWER
I20260807 10:46:31.877537 1311 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:31.877873 1311 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:46:31.878027 1311 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:46:31.878247 1311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 2 FOLLOWER]: Advancing to term 3
I20260807 10:46:31.884577 1311 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:31.885401 1311 leader_election.cc:302] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6daf01e69034d579b13622bf43f293f; no voters:
I20260807 10:46:31.886273 1311 leader_election.cc:288] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 10:46:31.886406 1317 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 3 FOLLOWER]: Leader election won for term 3
I20260807 10:46:31.887720 1317 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [term 3 LEADER]: Becoming Leader. State: Replica: b6daf01e69034d579b13622bf43f293f, State: Running, Role: LEADER
I20260807 10:46:31.888362 1317 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } }
I20260807 10:46:31.889098 1311 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:46:31.891044 1321 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6daf01e69034d579b13622bf43f293f. Latest consensus state: current_term: 3 leader_uuid: "b6daf01e69034d579b13622bf43f293f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } } }
I20260807 10:46:31.891451 1321 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:31.892096 1320 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b6daf01e69034d579b13622bf43f293f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6daf01e69034d579b13622bf43f293f" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 44679 } } }
I20260807 10:46:31.892403 1320 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6daf01e69034d579b13622bf43f293f [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:31.903643 1326 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:46:31.915333 1326 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:46:31.917248 1326 catalog_manager.cc:1259] Loaded cluster ID: 959caf4135a94acbb31238cc522935a1
I20260807 10:46:31.917532 1326 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 10:46:31.920329 1326 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9c6daeb9ad google::LogMessage::Fail() at ??:0
@ 0x7f9c6daee88a google::LogMessage::SendToLog() at ??:0
@ 0x7f9c6daeb4de google::LogMessage::Flush() at ??:0
@ 0x7f9c6daeca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260807 10:46:31.931504 1346 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f9c83522512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f9c8351f976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9c835a7610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f9c835a7439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9c70737345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9c7073a91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f9c7073a799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f9c70715eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9c739ef6db start_thread at ??:0
@ 0x7f9c6c98561f clone at ??:0
W20260807 10:46:32.283996 1314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:32.284343 1314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:32.284475 1314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:32.292279 1314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:32.292438 1314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:32.292600 1314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:46:32.303453 1314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:45703
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=35841
--tserver_master_addrs=127.11.46.190:44679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:32.305030 1314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:32.306659 1314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:32.323108 1379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:32.323145 1380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:32.323176 1383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:32.324625 1314 server_base.cc:1034] running on GCE node
I20260807 10:46:32.325481 1314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:32.326809 1314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:32.328213 1314 hybrid_clock.cc:648] HybridClock initialized: now 1786099592328136 us; error 76 us; skew 500 ppm
I20260807 10:46:32.328666 1314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:32 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099592, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:32.332886 1314 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:46:32.335000 1314 webserver.cc:460] Webserver started at http://127.11.46.129:35841/ using document root <none> and password file <none>
I20260807 10:46:32.335965 1314 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:32.336154 1314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:32.343408 1314 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 10:46:32.347249 1395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:32.349014 1314 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.003s
I20260807 10:46:32.349234 1314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e"
format_stamp: "Formatted at 2026-08-07 10:46:25 on dist-test-slave-42z9"
server_key: "21c33bc7c10bc4bf9a5c54c0213eaecf"
server_key_iv: "653862d7906be0f0f9a6a0dd5d482452"
server_key_version: "encryptionkey@0"
I20260807 10:46:32.350425 1314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:32.370147 1314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:32.375587 1314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:32.375902 1314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:32.377266 1314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:32.379907 1404 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260807 10:46:32.387055 1314 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 10:46:32.387254 1314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.008s user 0.001s sys 0.000s
I20260807 10:46:32.387406 1314 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 10:46:32.391139 1314 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 10:46:32.391244 1314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.003s sys 0.000s
I20260807 10:46:32.391733 1404 tablet_bootstrap.cc:492] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Bootstrap starting.
I20260807 10:46:32.401841 1404 log.cc:824] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:32.419271 1404 tablet_bootstrap.cc:492] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:46:32.419986 1404 tablet_bootstrap.cc:492] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Bootstrap complete.
I20260807 10:46:32.420646 1404 ts_tablet_manager.cc:1397] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Time spent bootstrapping tablet: real 0.029s user 0.023s sys 0.004s
I20260807 10:46:32.430855 1404 raft_consensus.cc:348] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:32.431939 1404 raft_consensus.cc:729] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa5bc4d1f3894277ae0f1c80a63ecd1e, State: Initialized, Role: FOLLOWER
I20260807 10:46:32.432683 1314 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:45703
I20260807 10:46:32.432711 1558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:45703 every 8 connection(s)
I20260807 10:46:32.432861 1404 consensus_queue.cc:260] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:32.434314 1314 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:46:32.434612 1404 ts_tablet_manager.cc:1428] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260807 10:46:32.439261 1562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:32.437236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:58261)
0807 10:46:32.438084 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:32.438328 (+ 244us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":368,"threads_started":1}
W20260807 10:46:32.440109 1560 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:44679 (0 consecutive failures): Network error: Failed to ping master at 127.11.46.190:44679: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
I20260807 10:46:32.440462 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 1314
I20260807 10:46:32.441118 1562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:32.440747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:42723)
0807 10:46:32.440921 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:32.440997 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 10:46:32.441124 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:42469
--local_ip_for_outbound_sockets=127.11.46.130
--tserver_master_addrs=127.11.46.190:44679
--webserver_port=43649
--webserver_interface=127.11.46.130
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:46:32.442032 1562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:32.441656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:50677)
0807 10:46:32.441814 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:32.441899 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 10:46:32.442271 1560 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 10:46:32.818974 1563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:32.819304 1563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:32.819435 1563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:32.827113 1563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:32.827250 1563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:32.827365 1563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:46:32.837805 1563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:42469
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=43649
--tserver_master_addrs=127.11.46.190:44679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:32.839214 1563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:32.840631 1563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:32.854782 1570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:32.854773 1574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:32.854821 1571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:32.856259 1563 server_base.cc:1034] running on GCE node
I20260807 10:46:32.856923 1563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:32.858076 1563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:32.859287 1563 hybrid_clock.cc:648] HybridClock initialized: now 1786099592859212 us; error 63 us; skew 500 ppm
I20260807 10:46:32.859671 1563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:32 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099592, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:32.867851 1563 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:46:32.869879 1563 webserver.cc:460] Webserver started at http://127.11.46.130:43649/ using document root <none> and password file <none>
I20260807 10:46:32.870733 1563 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:32.870875 1563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:32.877209 1563 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s
I20260807 10:46:32.880534 1582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:32.882148 1563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:46:32.882337 1563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "e89fef2506824aaaaad20be8fd13b4f2"
format_stamp: "Formatted at 2026-08-07 10:46:26 on dist-test-slave-42z9"
server_key: "75131adf5b197efcbaa44fad05bc9403"
server_key_iv: "3f1351a8d0a56a7bc6fb5a5c78fe165b"
server_key_version: "encryptionkey@0"
I20260807 10:46:32.883437 1563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:32.905109 1563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:32.909775 1563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:32.910076 1563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:32.911208 1563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:32.912734 1563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:32.912842 1563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:32.912963 1563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:32.913046 1563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:32.948307 1563 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:42469
I20260807 10:46:32.948369 1747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:42469 every 8 connection(s)
I20260807 10:46:32.949999 1563 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:46:32.956101 1750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:32.953891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:33633)
0807 10:46:32.954823 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:32.955075 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":409,"threads_started":1}
W20260807 10:46:32.956862 1748 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:44679 (0 consecutive failures): Network error: Failed to ping master at 127.11.46.190:44679: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
I20260807 10:46:32.957850 1750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:32.957506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:49793)
0807 10:46:32.957651 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:32.957728 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 10:46:32.958539 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 1563
I20260807 10:46:32.958801 1750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:32.958447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:41153)
0807 10:46:32.958574 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:32.958665 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 10:46:32.959082 1748 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 10:46:32.959273 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:39231
--local_ip_for_outbound_sockets=127.11.46.131
--tserver_master_addrs=127.11.46.190:44679
--webserver_port=40757
--webserver_interface=127.11.46.131
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:33.340619 1751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:33.340955 1751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:33.341058 1751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:33.348652 1751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:33.348796 1751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:33.348918 1751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:46:33.359360 1751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:39231
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=40757
--tserver_master_addrs=127.11.46.190:44679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:33.360767 1751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:33.362202 1751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:33.376611 1757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:33.376508 1758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:33.376556 1761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:33.377324 1751 server_base.cc:1034] running on GCE node
I20260807 10:46:33.378055 1751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:33.379112 1751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:33.380332 1751 hybrid_clock.cc:648] HybridClock initialized: now 1786099593380265 us; error 54 us; skew 500 ppm
I20260807 10:46:33.380681 1751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:33 dist-test-slave-42z9 krb5kdc[32068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099593, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:33.384179 1751 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:46:33.386034 1751 webserver.cc:460] Webserver started at http://127.11.46.131:40757/ using document root <none> and password file <none>
I20260807 10:46:33.386883 1751 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:33.387035 1751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:33.393365 1751 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 10:46:33.396692 1775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:33.398599 1751 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:46:33.398816 1751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "dd55452547104d37b9b5cf05c28118d3"
format_stamp: "Formatted at 2026-08-07 10:46:27 on dist-test-slave-42z9"
server_key: "74c67027246a28b275fd3b99e9afa54b"
server_key_iv: "7e0045c5a7cf2b4cb5de79e8375bddfe"
server_key_version: "encryptionkey@0"
I20260807 10:46:33.399977 1751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:33.413604 1751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:33.418609 1751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:33.418924 1751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:33.420115 1751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:33.421754 1751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:33.421871 1751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:33.421998 1751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:33.422073 1751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:33.443848 1874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:33.442986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:54997)
0807 10:46:33.443505 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:33.443609 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":222,"threads_started":1}
I20260807 10:46:33.460876 1751 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:39231
I20260807 10:46:33.460948 1957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:39231 every 8 connection(s)
I20260807 10:46:33.462563 1751 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:46:33.465152 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 1751
I20260807 10:46:33.468565 1966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:33.466243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:44595)
0807 10:46:33.467257 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:33.467566 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":356,"threads_started":1}
W20260807 10:46:33.469379 1959 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:44679 (0 consecutive failures): Network error: Failed to ping master at 127.11.46.190:44679: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
I20260807 10:46:33.470577 1966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:33.470141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:37601)
0807 10:46:33.470323 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:33.470414 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 10:46:33.471585 1966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:33.471216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:38595)
0807 10:46:33.471355 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:33.471448 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 10:46:33.471840 1959 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 10:46:33.960764 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:33.959817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:44879)
0807 10:46:33.960370 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:33.960506 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":272,"threads_started":1}
I20260807 10:46:34.244617 1969 raft_consensus.cc:482] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:46:34.244925 1969 raft_consensus.cc:504] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:34.246620 1969 leader_election.cc:288] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231), e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469)
Aug 07 10:46:34 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099592, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
Aug 07 10:46:34 dist-test-slave-42z9 krb5kdc[32068](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099592, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:46:34.282085 1973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:34.247232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:52665 (local address 127.11.46.131:39231)
0807 10:46:34.257633 (+ 10401us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:34.257654 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:34.258760 (+ 1106us) server_negotiation.cc:407] Connection header received
0807 10:46:34.260891 (+ 2131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:34.260903 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:34.261318 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:34.261717 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:34.264084 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:34.265688 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:34.267676 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:34.268344 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:34.268540 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:34.272909 (+ 4369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:34.272925 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:34.272947 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:34.273004 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:34.277005 (+ 4001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:34.278138 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:34.278149 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:34.278158 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:34.278385 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:34.278971 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:34.278976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:34.278980 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:34.279788 (+ 808us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:34.279987 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:34.281144 (+ 1157us) server_negotiation.cc:299] Negotiation successful
0807 10:46:34.281642 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10163,"thread_start_us":10028,"threads_started":1}
I20260807 10:46:34.282074 1974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:34.247348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:41063 (local address 127.11.46.130:42469)
0807 10:46:34.258621 (+ 11273us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:34.258638 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:34.259128 (+ 490us) server_negotiation.cc:407] Connection header received
0807 10:46:34.260905 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:34.260914 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:34.261317 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:34.261716 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:34.264095 (+ 2379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:34.265720 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:34.267680 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:34.268346 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:34.268546 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:34.272958 (+ 4412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:34.272967 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:34.272979 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:34.273032 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:34.276981 (+ 3949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:34.278139 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:34.278149 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:34.278158 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:34.278385 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:34.278971 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:34.278976 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:34.278980 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:34.279788 (+ 808us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:34.279987 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:34.281144 (+ 1157us) server_negotiation.cc:299] Negotiation successful
0807 10:46:34.281646 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11081,"thread_start_us":10906,"threads_started":1}
I20260807 10:46:34.282120 1970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:34.247049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:39231 (local address 127.11.46.129:52665)
0807 10:46:34.258039 (+ 10990us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:34.258099 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:34.258829 (+ 730us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:34.261927 (+ 3098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:34.261939 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:34.262960 (+ 1021us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:34.263828 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:34.263860 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:34.265911 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:34.265915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:34.267506 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:34.267522 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:34.268570 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:34.268578 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:34.268911 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:34.269827 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:34.269846 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:34.272500 (+ 2654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:34.277167 (+ 4667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:34.277180 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:34.277199 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:34.277990 (+ 791us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:34.278513 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:34.278519 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:34.278522 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:34.278853 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:34.279947 (+ 1094us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:34.279956 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:34.280487 (+ 531us) client_negotiation.cc:769] Sending connection context
0807 10:46:34.280841 (+ 354us) client_negotiation.cc:240] Negotiation successful
0807 10:46:34.281605 (+ 764us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10814,"mutex_wait_us":347,"spinlock_wait_cycles":75520,"thread_start_us":10633,"threads_started":1}
I20260807 10:46:34.282130 1971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:34.247152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:42469 (local address 127.11.46.129:41063)
0807 10:46:34.258959 (+ 11807us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:34.258997 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:34.259149 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:34.261927 (+ 2778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:34.261939 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:34.262967 (+ 1028us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:34.263827 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:34.263859 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:34.265911 (+ 2052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:34.265915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:34.267511 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:34.267525 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:34.268622 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:34.268631 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:34.268916 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:34.269778 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:34.269812 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:34.272660 (+ 2848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:34.277167 (+ 4507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:34.277180 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:34.277199 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:34.277990 (+ 791us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:34.278513 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:34.278519 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:34.278523 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:34.278853 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:34.279947 (+ 1094us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:34.279956 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:34.280487 (+ 531us) client_negotiation.cc:769] Sending connection context
0807 10:46:34.280841 (+ 354us) client_negotiation.cc:240] Negotiation successful
0807 10:46:34.281762 (+ 921us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11691,"mutex_wait_us":457,"spinlock_wait_cycles":50816,"thread_start_us":11471,"threads_started":1}
W20260807 10:46:34.285845 1399 leader_election.cc:341] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469): Not found: Tablet not found: fb8003018dff411387c64e53f0eeeb3c
W20260807 10:46:34.286135 1397 leader_election.cc:341] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231): Not found: Tablet not found: fb8003018dff411387c64e53f0eeeb3c
I20260807 10:46:34.286335 1397 leader_election.cc:302] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa5bc4d1f3894277ae0f1c80a63ecd1e; no voters: dd55452547104d37b9b5cf05c28118d3, e89fef2506824aaaaad20be8fd13b4f2
I20260807 10:46:34.286844 1969 raft_consensus.cc:2726] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 10:46:34.445683 1971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:34.445103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:46593)
0807 10:46:34.445363 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:34.445521 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 10:46:34.473668 1975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:34.472581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:43513)
0807 10:46:34.473157 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:34.473314 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":258,"threads_started":1}
I20260807 10:46:34.962705 1976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:34.961844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:39483)
0807 10:46:34.962399 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:34.962500 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":291,"threads_started":1}
I20260807 10:46:35.447783 1977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:35.446890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:38765)
0807 10:46:35.447459 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:35.447576 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":284,"threads_started":1}
I20260807 10:46:35.475584 1978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:35.474714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:59043)
0807 10:46:35.475271 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:35.475379 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":272,"threads_started":1}
I20260807 10:46:35.964706 1980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:35.963847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:35829)
0807 10:46:35.964410 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:35.964512 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":269,"threads_started":1}
I20260807 10:46:36.449683 1981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:36.448864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:42713)
0807 10:46:36.449368 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:36.449499 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":266,"threads_started":1}
I20260807 10:46:36.477648 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:36.476675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:54061)
0807 10:46:36.477278 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:36.477382 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":314,"threads_started":1}
I20260807 10:46:36.498811 1985 raft_consensus.cc:482] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:46:36.499068 1985 raft_consensus.cc:504] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:36.499825 1985 leader_election.cc:288] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231), e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469)
W20260807 10:46:36.501025 1397 leader_election.cc:341] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231): Not found: Tablet not found: fb8003018dff411387c64e53f0eeeb3c
W20260807 10:46:36.501214 1399 leader_election.cc:341] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469): Not found: Tablet not found: fb8003018dff411387c64e53f0eeeb3c
I20260807 10:46:36.501343 1399 leader_election.cc:302] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa5bc4d1f3894277ae0f1c80a63ecd1e; no voters: dd55452547104d37b9b5cf05c28118d3, e89fef2506824aaaaad20be8fd13b4f2
I20260807 10:46:36.501690 1985 raft_consensus.cc:2726] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 10:46:36.966619 1986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:36.965818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:43055)
0807 10:46:36.966327 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:36.966421 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":261,"threads_started":1}
I20260807 10:46:37.451727 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:37.450836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:44215)
0807 10:46:37.451419 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:37.451516 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":279,"threads_started":1}
I20260807 10:46:37.479732 1988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:37.478823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:46665)
0807 10:46:37.479422 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:37.479525 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":276,"threads_started":1}
I20260807 10:46:37.968775 1989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:37.967882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:42707)
0807 10:46:37.968444 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:37.968544 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":302,"threads_started":1}
I20260807 10:46:38.454763 1991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:38.453194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:54741)
0807 10:46:38.454117 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:38.454372 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":649,"thread_start_us":415,"threads_started":1}
I20260807 10:46:38.482435 1993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:38.481109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:33339)
0807 10:46:38.481904 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:38.482112 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":455,"threads_started":1}
I20260807 10:46:38.971246 1994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:38.970087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:55229)
0807 10:46:38.970799 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:38.970953 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":354,"threads_started":1}
I20260807 10:46:39.278484 1996 raft_consensus.cc:482] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:46:39.278820 1996 raft_consensus.cc:504] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:39.280195 1996 leader_election.cc:288] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231), e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469)
W20260807 10:46:39.281641 1399 leader_election.cc:341] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469): Not found: Tablet not found: fb8003018dff411387c64e53f0eeeb3c
W20260807 10:46:39.281890 1397 leader_election.cc:341] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231): Not found: Tablet not found: fb8003018dff411387c64e53f0eeeb3c
I20260807 10:46:39.282094 1397 leader_election.cc:302] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa5bc4d1f3894277ae0f1c80a63ecd1e; no voters: dd55452547104d37b9b5cf05c28118d3, e89fef2506824aaaaad20be8fd13b4f2
I20260807 10:46:39.282516 1996 raft_consensus.cc:2726] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 10:46:39.457413 1998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:39.456172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:42123)
0807 10:46:39.456928 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:39.457099 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":329,"threads_started":1}
I20260807 10:46:39.485133 1999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:39.483909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:44635)
0807 10:46:39.484693 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:39.484840 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":409,"threads_started":1}
I20260807 10:46:39.973255 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:39.972340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:45167)
0807 10:46:39.972949 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:39.973047 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":309,"threads_started":1}
I20260807 10:46:40.459633 2001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:40.458676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:48607)
0807 10:46:40.459311 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:40.459433 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":297,"threads_started":1}
I20260807 10:46:40.487632 2003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:40.486573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:48687)
0807 10:46:40.487245 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:40.487366 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":280,"threads_started":1}
I20260807 10:46:40.975358 2004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:40.974459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:60867)
0807 10:46:40.975021 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:40.975136 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":292,"threads_started":1}
I20260807 10:46:41.461689 2005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:41.460703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:56455)
0807 10:46:41.461305 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:41.461425 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":273,"threads_started":1}
I20260807 10:46:41.489701 2006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:41.488795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:41225)
0807 10:46:41.489331 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:41.489432 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":276,"threads_started":1}
I20260807 10:46:41.977378 2009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:41.976515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:41021)
0807 10:46:41.977101 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:41.977204 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":277,"threads_started":1}
I20260807 10:46:42.463748 2011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:42.462905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:48023)
0807 10:46:42.463465 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:42.463561 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":316,"threads_started":1}
I20260807 10:46:42.491672 2012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:42.490779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:37371)
0807 10:46:42.491393 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:42.491492 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":299,"threads_started":1}
I20260807 10:46:42.979203 2014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:42.978448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:45863)
0807 10:46:42.978927 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:42.979012 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":245,"threads_started":1}
I20260807 10:46:43.465663 2016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:43.464774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:44545)
0807 10:46:43.465291 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:43.465408 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":265,"threads_started":1}
I20260807 10:46:43.493664 2017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:43.492812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:53169)
0807 10:46:43.493327 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:43.493421 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":277,"threads_started":1}
I20260807 10:46:43.622068 2020 raft_consensus.cc:482] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:46:43.622334 2020 raft_consensus.cc:504] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:43.623119 2020 leader_election.cc:288] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231), e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469)
W20260807 10:46:43.624301 1397 leader_election.cc:341] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231): Not found: Tablet not found: fb8003018dff411387c64e53f0eeeb3c
W20260807 10:46:43.624536 1399 leader_election.cc:341] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469): Not found: Tablet not found: fb8003018dff411387c64e53f0eeeb3c
I20260807 10:46:43.624650 1399 leader_election.cc:302] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa5bc4d1f3894277ae0f1c80a63ecd1e; no voters: dd55452547104d37b9b5cf05c28118d3, e89fef2506824aaaaad20be8fd13b4f2
I20260807 10:46:43.624936 2020 raft_consensus.cc:2726] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 10:46:43.981180 2021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:43.980259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:53385)
0807 10:46:43.980892 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:43.980996 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":347,"threads_started":1}
I20260807 10:46:44.467556 2022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:44.466712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:52203)
0807 10:46:44.467256 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:44.467357 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":260,"threads_started":1}
I20260807 10:46:44.495828 2023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:44.494857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:58869)
0807 10:46:44.495528 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:44.495632 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":370,"threads_started":1}
I20260807 10:46:44.983181 2024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:44.982322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:45799)
0807 10:46:44.982876 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:44.982974 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":289,"threads_started":1}
I20260807 10:46:45.469640 2025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:45.468775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:46489)
0807 10:46:45.469263 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:45.469369 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":243,"threads_started":1}
I20260807 10:46:45.497745 2026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:45.496874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:59987)
0807 10:46:45.497408 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:45.497548 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":282,"threads_started":1}
I20260807 10:46:45.985301 2027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:45.984355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:58439)
0807 10:46:45.984998 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:45.985110 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":315,"threads_started":1}
I20260807 10:46:46.471508 2029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:46.470697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:56253)
0807 10:46:46.471209 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:46.471307 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":286,"threads_started":1}
I20260807 10:46:46.499739 2030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:46.498828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:54247)
0807 10:46:46.499435 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:46.499557 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":292,"threads_started":1}
I20260807 10:46:46.987433 2031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:46.986396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:46989)
0807 10:46:46.987069 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:46.987169 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":370,"threads_started":1}
I20260807 10:46:47.473872 2032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:47.472862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:57315)
0807 10:46:47.473568 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:47.473676 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":283,"threads_started":1}
I20260807 10:46:47.501828 2034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:47.500868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:46741)
0807 10:46:47.501490 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:47.501603 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":292,"threads_started":1}
I20260807 10:46:47.677292 2035 raft_consensus.cc:482] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:46:47.677584 2035 raft_consensus.cc:504] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa5bc4d1f3894277ae0f1c80a63ecd1e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45703 } } peers { permanent_uuid: "dd55452547104d37b9b5cf05c28118d3" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39231 } } peers { permanent_uuid: "e89fef2506824aaaaad20be8fd13b4f2" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 42469 } }
I20260807 10:46:47.678355 2035 leader_election.cc:288] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231), e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469)
W20260807 10:46:47.680029 1397 leader_election.cc:341] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dd55452547104d37b9b5cf05c28118d3 (127.11.46.131:39231): Not found: Tablet not found: fb8003018dff411387c64e53f0eeeb3c
W20260807 10:46:47.680269 1399 leader_election.cc:341] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e89fef2506824aaaaad20be8fd13b4f2 (127.11.46.130:42469): Not found: Tablet not found: fb8003018dff411387c64e53f0eeeb3c
I20260807 10:46:47.680379 1399 leader_election.cc:302] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa5bc4d1f3894277ae0f1c80a63ecd1e; no voters: dd55452547104d37b9b5cf05c28118d3, e89fef2506824aaaaad20be8fd13b4f2
I20260807 10:46:47.680640 2035 raft_consensus.cc:2726] T fb8003018dff411387c64e53f0eeeb3c P aa5bc4d1f3894277ae0f1c80a63ecd1e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 10:46:47.989784 2036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:47.988795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.130:46723)
0807 10:46:47.989349 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:47.989569 (+ 220us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":255,"threads_started":1}
I20260807 10:46:48.474963 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 1314
I20260807 10:46:48.476374 2040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:48.475038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.129:39521)
0807 10:46:48.476043 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:48.476146 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":881,"thread_start_us":767,"threads_started":1}
I20260807 10:46:48.497778 2041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:48.476356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37588 (local address 127.11.46.129:45703)
0807 10:46:48.477164 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:48.477174 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:48.477642 (+ 468us) server_negotiation.cc:407] Connection header received
0807 10:46:48.477915 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:48.477924 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:48.478252 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:48.478413 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:48.480110 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:48.481143 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:48.482498 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:48.483115 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:48.483242 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:48.490860 (+ 7618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:48.490883 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:48.490903 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:48.490959 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:48.494274 (+ 3315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:48.495197 (+ 923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:48.495208 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:48.495211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:48.495384 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:48.495846 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:48.495850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:48.495852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:48.496314 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:48.496682 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:48.497070 (+ 388us) server_negotiation.cc:299] Negotiation successful
0807 10:46:48.497384 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":490,"threads_started":1}
I20260807 10:46:48.499250 1553 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:48.504160 2046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:48.503204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:44679 (local address 127.11.46.131:34605)
0807 10:46:48.503835 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:48.503953 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":291,"threads_started":1}
I20260807 10:46:48.596488 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 1314
I20260807 10:46:48.626564 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 1563
I20260807 10:46:48.641649 2047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:48.627405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49374 (local address 127.11.46.130:42469)
0807 10:46:48.627959 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:48.627963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:48.627980 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:46:48.628040 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:48.628043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:48.628106 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:48.628206 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:48.629709 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:48.630528 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:48.631858 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:48.632359 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:48.632483 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:48.635628 (+ 3145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:48.635634 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:48.635638 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:48.635683 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:48.638553 (+ 2870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:48.639318 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:48.639323 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:48.639326 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:48.639513 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:48.639914 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:48.639918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:48.639921 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:48.640250 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:48.640536 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:48.640853 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 10:46:48.641117 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":298,"threads_started":1}
I20260807 10:46:48.642431 1741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:48.735311 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 1563
I20260807 10:46:48.766987 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 1751
I20260807 10:46:48.782495 2050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:48.768042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41676 (local address 127.11.46.131:39231)
0807 10:46:48.768657 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:48.768662 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:48.768682 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:46:48.768746 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:48.768750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:48.768829 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:48.768938 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:48.770715 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:48.771619 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:48.773039 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:48.773564 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:48.773693 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:48.776504 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:48.776510 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:48.776513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:48.776566 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:48.779455 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:48.780312 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:48.780318 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:48.780320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:48.780495 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:48.780910 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:48.780915 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:48.780917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:48.781230 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:48.781567 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:48.781862 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 10:46:48.782110 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":302,"threads_started":1}
I20260807 10:46:48.783376 1952 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:48.873780 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 1751
2026-08-07T10:46:48Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25911 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:46:49 dist-test-slave-42z9 krb5kdc[2056](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:46:49 dist-test-slave-42z9 krb5kdc[2056](info): set up 2 sockets
Aug 07 10:46:49 dist-test-slave-42z9 krb5kdc[2056](info): commencing operation
krb5kdc: starting...
W20260807 10:46:50.143968 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.005s sys 0.056s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:46:50 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:46:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:46:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:46:50.540815 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:46599
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:46599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:50.934916 2077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:50.935262 2077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:50.935395 2077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:50.943295 2077 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 10:46:50.943437 2077 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 10:46:50.943480 2077 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 10:46:50.943553 2077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:46:50.943634 2077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:50.943738 2077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:50.943797 2077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:46:50.943856 2077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:46:50.954979 2077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:46599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:46599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:50.956607 2077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:50.958376 2077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:50.971480 2090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:50.971689 2088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:50.971426 2092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:50.972218 2077 server_base.cc:1034] running on GCE node
I20260807 10:46:50.973115 2077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:50.974764 2077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:50.976008 2077 hybrid_clock.cc:648] HybridClock initialized: now 1786099610975937 us; error 46 us; skew 500 ppm
I20260807 10:46:50.976406 2077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:50 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099610, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:50.980067 2077 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:46:50.981997 2077 webserver.cc:460] Webserver started at http://127.11.46.190:37009/ using document root <none> and password file <none>
I20260807 10:46:50.982863 2077 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:50.982976 2077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:50.983345 2077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:50.987011 2077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "a3431eaa7aec42e399c214739d2cd73a"
format_stamp: "Formatted at 2026-08-07 10:46:50 on dist-test-slave-42z9"
server_key: "bffd927760edb54458f662ac53763534"
server_key_iv: "5c15289c82c0cef10334e2a35b4dba94"
server_key_version: "encryptionkey@0"
I20260807 10:46:50.988000 2077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "a3431eaa7aec42e399c214739d2cd73a"
format_stamp: "Formatted at 2026-08-07 10:46:50 on dist-test-slave-42z9"
server_key: "bffd927760edb54458f662ac53763534"
server_key_iv: "5c15289c82c0cef10334e2a35b4dba94"
server_key_version: "encryptionkey@0"
I20260807 10:46:50.994365 2077 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260807 10:46:50.998697 2101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:51.000291 2077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:46:51.000519 2077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "a3431eaa7aec42e399c214739d2cd73a"
format_stamp: "Formatted at 2026-08-07 10:46:50 on dist-test-slave-42z9"
server_key: "bffd927760edb54458f662ac53763534"
server_key_iv: "5c15289c82c0cef10334e2a35b4dba94"
server_key_version: "encryptionkey@0"
I20260807 10:46:51.000774 2077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:51.019429 2077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:51.024173 2077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:51.024454 2077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:51.043239 2077 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:46599
I20260807 10:46:51.043219 2169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:46599 every 8 connection(s)
I20260807 10:46:51.044883 2077 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:46:51.049273 2171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:51.049599 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 2077
I20260807 10:46:51.049810 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:46:51.050488 11450 external_mini_cluster.cc:1428] Setting key 95d7b85d4ac79f6e72dc4886795c1f1e
I20260807 10:46:51.065825 2171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Bootstrap starting.
I20260807 10:46:51.069680 2171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Neither blocks nor log segments found. Creating new log.
Aug 07 10:46:51 dist-test-slave-42z9 krb5kdc[2056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:51.070911 2171 log.cc:824] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:51.075050 2171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: No bootstrap required, opened a new log
I20260807 10:46:51.081101 2174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:51.052697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49084 (local address 127.11.46.190:46599)
0807 10:46:51.053621 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:51.053637 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:51.053691 (+ 54us) server_negotiation.cc:407] Connection header received
0807 10:46:51.056690 (+ 2999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:51.056734 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:51.057401 (+ 667us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:51.058057 (+ 656us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:51.060058 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:51.062034 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:51.064990 (+ 2956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:51.066157 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:51.066373 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:51.071148 (+ 4775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:51.071163 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:51.071185 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:51.071245 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:51.075363 (+ 4118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:51.076309 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:51.076320 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:51.076331 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:51.076596 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:51.077076 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:51.077086 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:51.077089 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:51.078011 (+ 922us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:51.078359 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:51.078870 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 10:46:51.079449 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":368,"threads_started":1}
I20260807 10:46:51.085777 2171 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:46:51.086199 2171 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:51.086287 2171 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3431eaa7aec42e399c214739d2cd73a, State: Initialized, Role: FOLLOWER
I20260807 10:46:51.086884 2171 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:46:51.087139 2171 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:46:51.087245 2171 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:46:51.087383 2171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:51.089810 2171 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:46:51.090396 2171 leader_election.cc:302] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3431eaa7aec42e399c214739d2cd73a; no voters:
I20260807 10:46:51.091112 2171 leader_election.cc:288] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:46:51.091246 2177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:46:51.091941 2177 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 1 LEADER]: Becoming Leader. State: Replica: a3431eaa7aec42e399c214739d2cd73a, State: Running, Role: LEADER
I20260807 10:46:51.092671 2177 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:46:51.094007 2171 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:46:51.096207 2182 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3431eaa7aec42e399c214739d2cd73a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } } }
I20260807 10:46:51.096328 2179 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3431eaa7aec42e399c214739d2cd73a. Latest consensus state: current_term: 1 leader_uuid: "a3431eaa7aec42e399c214739d2cd73a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } } }
I20260807 10:46:51.096859 2182 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:51.096868 2179 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: This master's current role is: LEADER
I20260807 10:46:51.100149 2194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:46:51.106300 2194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:46:51.117231 2194 catalog_manager.cc:1347] Generated new cluster ID: bdd4aa46217d44fd8af8aebb8f41595e
I20260807 10:46:51.117378 2194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:46:51.130597 2194 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:46:51.132795 2194 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:46:51.144438 2194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Generated new TSK 0
I20260807 10:46:51.145838 2194 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:46:51.231917 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46599
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:51.633260 2209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:51.633693 2209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:51.633816 2209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:51.641660 2209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:51.641803 2209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:51.641930 2209 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:46:51.652558 2209 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:51.654103 2209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:51.655561 2209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:51.670559 2220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:51.670632 2219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:51.670593 2222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:51.671814 2209 server_base.cc:1034] running on GCE node
I20260807 10:46:51.672562 2209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:51.673746 2209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:51.674979 2209 hybrid_clock.cc:648] HybridClock initialized: now 1786099611674914 us; error 57 us; skew 500 ppm
I20260807 10:46:51.675339 2209 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:51 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099611, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:51.678867 2209 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:46:51.680564 2209 webserver.cc:460] Webserver started at http://127.11.46.129:34667/ using document root <none> and password file <none>
I20260807 10:46:51.681335 2209 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:51.681488 2209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:51.681831 2209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:51.685060 2209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "57109477fdd54dd4ba621fa68b60da54"
format_stamp: "Formatted at 2026-08-07 10:46:51 on dist-test-slave-42z9"
server_key: "b83325c39ec826da51355f7d8c26cd0d"
server_key_iv: "e0d46e97b125d7a0dbc6177ee5ddfcea"
server_key_version: "encryptionkey@0"
I20260807 10:46:51.685918 2209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "57109477fdd54dd4ba621fa68b60da54"
format_stamp: "Formatted at 2026-08-07 10:46:51 on dist-test-slave-42z9"
server_key: "b83325c39ec826da51355f7d8c26cd0d"
server_key_iv: "e0d46e97b125d7a0dbc6177ee5ddfcea"
server_key_version: "encryptionkey@0"
I20260807 10:46:51.692291 2209 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:46:51.696928 2233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:51.698671 2209 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:46:51.698884 2209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "57109477fdd54dd4ba621fa68b60da54"
format_stamp: "Formatted at 2026-08-07 10:46:51 on dist-test-slave-42z9"
server_key: "b83325c39ec826da51355f7d8c26cd0d"
server_key_iv: "e0d46e97b125d7a0dbc6177ee5ddfcea"
server_key_version: "encryptionkey@0"
I20260807 10:46:51.699182 2209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:51.723799 2209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:51.728832 2209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:51.729168 2209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:51.730450 2209 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:51.732108 2209 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:51.732204 2209 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:51.732319 2209 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:51.732379 2209 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:51.767932 2209 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:37375
I20260807 10:46:51.768020 2387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:37375 every 8 connection(s)
I20260807 10:46:51.769572 2209 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:46:51.770784 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 2209
I20260807 10:46:51.771057 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:46:51.771957 11450 external_mini_cluster.cc:1428] Setting key 92190fe9b4e20cf07b1f7557a60ce727
Aug 07 10:46:51 dist-test-slave-42z9 krb5kdc[2056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099611, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:51.799033 2393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:51.774332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:54997 (local address 127.11.46.190:46599)
0807 10:46:51.776635 (+ 2303us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:51.776642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:51.777585 (+ 943us) server_negotiation.cc:407] Connection header received
0807 10:46:51.780370 (+ 2785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:51.780375 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:51.780482 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:51.780604 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:51.783075 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:51.783882 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:51.786362 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:51.786815 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:51.786952 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:51.791692 (+ 4740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:51.791709 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:51.791713 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:51.791758 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:51.795136 (+ 3378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:51.796144 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:51.796151 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:51.796154 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:51.796343 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:51.796825 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:51.796830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:51.796833 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:51.797215 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:51.797372 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:51.798336 (+ 964us) server_negotiation.cc:299] Negotiation successful
0807 10:46:51.798620 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2161,"thread_start_us":2030,"threads_started":1}
I20260807 10:46:51.800091 2396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:51.774161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:54997)
0807 10:46:51.777311 (+ 3150us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:51.777400 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:51.779963 (+ 2563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:51.780946 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:51.780959 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:51.781834 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:51.782771 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:51.782803 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:51.784092 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:51.784098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:51.786149 (+ 2051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:51.786171 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:51.787100 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:51.787107 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:51.787437 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:51.788249 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:51.788283 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:51.791312 (+ 3029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:51.795363 (+ 4051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:51.795373 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:51.795398 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:51.795964 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:51.796467 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:51.796471 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:51.796473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:51.796696 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:51.797369 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:51.797378 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:51.797845 (+ 467us) client_negotiation.cc:769] Sending connection context
0807 10:46:51.798155 (+ 310us) client_negotiation.cc:240] Negotiation successful
0807 10:46:51.798704 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2769,"thread_start_us":2459,"threads_started":1}
I20260807 10:46:51.801931 2388 heartbeater.cc:347] Connected to a master server at 127.11.46.190:46599
I20260807 10:46:51.802343 2388 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:51.803470 2388 heartbeater.cc:511] Master 127.11.46.190:46599 requested a full tablet report, sending...
I20260807 10:46:51.806118 2123 ts_manager.cc:194] Registered new tserver with Master: 57109477fdd54dd4ba621fa68b60da54 (127.11.46.129:37375)
I20260807 10:46:51.807741 2123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:54997
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:46:51.856595 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46599
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:46:52.254714 2402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:52.255074 2402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:52.255214 2402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:52.263108 2402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:52.263279 2402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:52.263458 2402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:46:52.274557 2402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:52.276134 2402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:52.277776 2402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:52.292322 2410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:52.292353 2409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:52.292418 2414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:52.293247 2402 server_base.cc:1034] running on GCE node
I20260807 10:46:52.293969 2402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:52.295158 2402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:52.296469 2402 hybrid_clock.cc:648] HybridClock initialized: now 1786099612296406 us; error 47 us; skew 500 ppm
I20260807 10:46:52.296833 2402 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:52 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099612, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:52.300705 2402 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:46:52.302577 2402 webserver.cc:460] Webserver started at http://127.11.46.130:36847/ using document root <none> and password file <none>
I20260807 10:46:52.303519 2402 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:52.303674 2402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:52.304018 2402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:52.307734 2402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "31c03620c5fc4836956710561ff9957f"
format_stamp: "Formatted at 2026-08-07 10:46:52 on dist-test-slave-42z9"
server_key: "1b46d7e63d61bf3129fe1d19899d97ea"
server_key_iv: "84518f6570706f9bb0292d3162db7b54"
server_key_version: "encryptionkey@0"
I20260807 10:46:52.308627 2402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "31c03620c5fc4836956710561ff9957f"
format_stamp: "Formatted at 2026-08-07 10:46:52 on dist-test-slave-42z9"
server_key: "1b46d7e63d61bf3129fe1d19899d97ea"
server_key_iv: "84518f6570706f9bb0292d3162db7b54"
server_key_version: "encryptionkey@0"
I20260807 10:46:52.315029 2402 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:46:52.319271 2424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:52.321096 2402 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260807 10:46:52.321285 2402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "31c03620c5fc4836956710561ff9957f"
format_stamp: "Formatted at 2026-08-07 10:46:52 on dist-test-slave-42z9"
server_key: "1b46d7e63d61bf3129fe1d19899d97ea"
server_key_iv: "84518f6570706f9bb0292d3162db7b54"
server_key_version: "encryptionkey@0"
I20260807 10:46:52.321575 2402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:52.362605 2402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:52.368352 2402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:52.368717 2402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:52.370062 2402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:52.371760 2402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:52.371874 2402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:52.372007 2402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:52.372068 2402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:52.407644 2402 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:40605
I20260807 10:46:52.407691 2572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:40605 every 8 connection(s)
I20260807 10:46:52.409154 2402 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:46:52.415658 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 2402
I20260807 10:46:52.415879 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:46:52.416476 11450 external_mini_cluster.cc:1428] Setting key 316cfdcc174b951b03d43733a3b7bdc0
Aug 07 10:46:52 dist-test-slave-42z9 krb5kdc[2056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099612, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:52.431798 2575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:52.412170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:52307 (local address 127.11.46.190:46599)
0807 10:46:52.412696 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:52.412701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:52.413836 (+ 1135us) server_negotiation.cc:407] Connection header received
0807 10:46:52.416125 (+ 2289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:52.416129 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:52.416217 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:52.416318 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:52.418423 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:52.419212 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:52.420885 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:52.421340 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:52.421480 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:52.425270 (+ 3790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:52.425277 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:52.425282 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:52.425331 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:52.428248 (+ 2917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:52.429135 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:52.429140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:52.429143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:52.429283 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:52.429817 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:52.429821 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:52.429823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:52.430147 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:52.430299 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:52.431144 (+ 845us) server_negotiation.cc:299] Negotiation successful
0807 10:46:52.431406 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":287,"threads_started":1}
I20260807 10:46:52.432931 2576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:52.412811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:52307)
0807 10:46:52.413665 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:52.413717 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:52.415755 (+ 2038us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:52.416652 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:52.416666 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:52.417417 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:52.418237 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:52.418258 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:52.419392 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:52.419396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:52.420723 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:52.420738 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:52.421631 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:52.421640 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:52.421879 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:52.422596 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:52.422621 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:52.424996 (+ 2375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:52.428429 (+ 3433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:52.428440 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:52.428461 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:52.428985 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:52.429401 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:52.429406 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:52.429410 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:52.429685 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:52.430296 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:52.430306 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:52.430725 (+ 419us) client_negotiation.cc:769] Sending connection context
0807 10:46:52.431003 (+ 278us) client_negotiation.cc:240] Negotiation successful
0807 10:46:52.431652 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":321,"threads_started":1}
I20260807 10:46:52.434554 2573 heartbeater.cc:347] Connected to a master server at 127.11.46.190:46599
I20260807 10:46:52.434902 2573 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:52.435782 2573 heartbeater.cc:511] Master 127.11.46.190:46599 requested a full tablet report, sending...
I20260807 10:46:52.437704 2123 ts_manager.cc:194] Registered new tserver with Master: 31c03620c5fc4836956710561ff9957f (127.11.46.130:40605)
I20260807 10:46:52.438591 2123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:52307
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:46:52.500047 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46599
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:46:52.812160 2388 heartbeater.cc:503] Master 127.11.46.190:46599 was elected leader, sending a full tablet report...
W20260807 10:46:52.892350 2580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:46:52.892680 2580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:46:52.892824 2580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:46:52.900614 2580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:46:52.900766 2580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:46:52.900921 2580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:46:52.911799 2580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:46599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:46:52.913297 2580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:46:52.914844 2580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:46:52.929639 2593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:52.929610 2594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:46:52.929571 2596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:46:52.930579 2580 server_base.cc:1034] running on GCE node
I20260807 10:46:52.931326 2580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:46:52.932509 2580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:46:52.933753 2580 hybrid_clock.cc:648] HybridClock initialized: now 1786099612933692 us; error 50 us; skew 500 ppm
I20260807 10:46:52.934186 2580 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:46:52 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099612, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:46:52.937407 2580 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:46:52.939041 2580 webserver.cc:460] Webserver started at http://127.11.46.131:39239/ using document root <none> and password file <none>
I20260807 10:46:52.939883 2580 fs_manager.cc:359] Metadata directory not provided
I20260807 10:46:52.940024 2580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:46:52.940373 2580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:46:52.943684 2580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "a7024955fd2a4011903d1efc52151561"
format_stamp: "Formatted at 2026-08-07 10:46:52 on dist-test-slave-42z9"
server_key: "e15456f5dd92e495cb493eb019ea9c94"
server_key_iv: "d1ef79a4b527a014da12cdaf01eb1eab"
server_key_version: "encryptionkey@0"
I20260807 10:46:52.944566 2580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "a7024955fd2a4011903d1efc52151561"
format_stamp: "Formatted at 2026-08-07 10:46:52 on dist-test-slave-42z9"
server_key: "e15456f5dd92e495cb493eb019ea9c94"
server_key_iv: "d1ef79a4b527a014da12cdaf01eb1eab"
server_key_version: "encryptionkey@0"
I20260807 10:46:52.950789 2580 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260807 10:46:52.955027 2604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:52.956686 2580 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260807 10:46:52.956898 2580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "a7024955fd2a4011903d1efc52151561"
format_stamp: "Formatted at 2026-08-07 10:46:52 on dist-test-slave-42z9"
server_key: "e15456f5dd92e495cb493eb019ea9c94"
server_key_iv: "d1ef79a4b527a014da12cdaf01eb1eab"
server_key_version: "encryptionkey@0"
I20260807 10:46:52.957141 2580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:46:52.974128 2580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:46:52.978703 2580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:46:52.979041 2580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:46:52.980194 2580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:46:52.981854 2580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:46:52.981945 2580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:52.982101 2580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:46:52.982174 2580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:46:53.015874 2580 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:35011
I20260807 10:46:53.015915 2765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:35011 every 8 connection(s)
I20260807 10:46:53.017293 2580 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:46:53.021618 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 2580
I20260807 10:46:53.021836 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:46:53.022472 11450 external_mini_cluster.cc:1428] Setting key cb7e7cdff7b8cebfe163149a33c0b6be
Aug 07 10:46:53 dist-test-slave-42z9 krb5kdc[2056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099612, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:46:53.041386 2772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.020200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:58287 (local address 127.11.46.190:46599)
0807 10:46:53.020677 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.020682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.023147 (+ 2465us) server_negotiation.cc:407] Connection header received
0807 10:46:53.024488 (+ 1341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.024494 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.024613 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.024722 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:53.026946 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.027831 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.029821 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.030280 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.030402 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.034361 (+ 3959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:53.034367 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:53.034371 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:53.034423 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:53.037955 (+ 3532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:53.038960 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:53.038966 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:53.038969 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:53.039154 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:53.039662 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:53.039666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:53.039668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:53.039988 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:53.040116 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.040887 (+ 771us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.041088 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":253,"threads_started":1}
I20260807 10:46:53.042526 2773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.020739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:58287)
0807 10:46:53.021763 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:53.021826 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:53.024123 (+ 2297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:53.025067 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:53.025081 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:53.025854 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:46:53.026752 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.026781 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.028073 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.028078 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.029630 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.029650 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.030550 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.030555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.030814 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.031566 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:46:53.031595 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:46:53.034069 (+ 2474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:46:53.038130 (+ 4061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:53.038140 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:53.038157 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:53.038796 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:53.039279 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:46:53.039283 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:46:53.039286 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:46:53.039562 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:46:53.040132 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:46:53.040139 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:46:53.040537 (+ 398us) client_negotiation.cc:769] Sending connection context
0807 10:46:53.040789 (+ 252us) client_negotiation.cc:240] Negotiation successful
0807 10:46:53.041236 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":354,"threads_started":1}
I20260807 10:46:53.044229 2767 heartbeater.cc:347] Connected to a master server at 127.11.46.190:46599
I20260807 10:46:53.044587 2767 heartbeater.cc:464] Registering TS with master...
I20260807 10:46:53.045481 2767 heartbeater.cc:511] Master 127.11.46.190:46599 requested a full tablet report, sending...
I20260807 10:46:53.047216 2123 ts_manager.cc:194] Registered new tserver with Master: a7024955fd2a4011903d1efc52151561 (127.11.46.131:35011)
I20260807 10:46:53.048135 2123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:58287
I20260807 10:46:53.051947 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:46:53.071578 2772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.057305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49088 (local address 127.11.46.190:46599)
0807 10:46:53.057585 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.057593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.057929 (+ 336us) server_negotiation.cc:407] Connection header received
0807 10:46:53.058137 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.058141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.058242 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.058338 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:53.059931 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.060713 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.062407 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.062901 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.063038 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.065779 (+ 2741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:53.065785 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:53.065788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:53.065836 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:53.068547 (+ 2711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:53.069342 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:53.069347 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:53.069349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:53.069560 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:53.069982 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:53.069987 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:53.069989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:53.070357 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:53.070622 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.070984 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.071243 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:46:53.077567 2123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:46:53.085039 2123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:46:53.123006 2790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.099389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:35011 (local address 127.0.0.1:44290)
0807 10:46:53.113309 (+ 13920us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:53.113880 (+ 571us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:53.114023 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:53.114982 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:53.114986 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:53.115015 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:53.115570 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.115580 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.117384 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.117390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.119535 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.119550 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.121269 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.121277 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.121541 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.121625 (+ 84us) client_negotiation.cc:769] Sending connection context
0807 10:46:53.121791 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 10:46:53.122021 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13483,"mutex_wait_us":160,"thread_start_us":13315,"threads_started":1}
I20260807 10:46:53.123667 2796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.103056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41568 (local address 127.11.46.130:40605)
0807 10:46:53.109039 (+ 5983us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.109051 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.114253 (+ 5202us) server_negotiation.cc:407] Connection header received
0807 10:46:53.114408 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.114417 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.114677 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.114915 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:53.115805 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.117339 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.120536 (+ 3197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.121997 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.122141 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.122344 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.122932 (+ 588us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.123326 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5791,"thread_start_us":5611,"threads_started":1}
I20260807 10:46:53.122469 2793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.099713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44290 (local address 127.11.46.131:35011)
0807 10:46:53.111158 (+ 11445us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.111167 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.114162 (+ 2995us) server_negotiation.cc:407] Connection header received
0807 10:46:53.114272 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.114279 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.114502 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.114679 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:53.115789 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.117206 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.119735 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.121020 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.121189 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.121520 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.121866 (+ 346us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.122062 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11248,"thread_start_us":11070,"threads_started":1}
I20260807 10:46:53.124233 2792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.099652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.0.0.1:58540)
0807 10:46:53.113309 (+ 13657us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:53.113392 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:53.113637 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:53.114740 (+ 1103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:53.114748 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:53.114781 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:53.115334 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.115349 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.117396 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.117402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.120323 (+ 2921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.120341 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.122395 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.122402 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.122615 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.122649 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 10:46:53.123710 (+ 1061us) client_negotiation.cc:240] Negotiation successful
0807 10:46:53.123857 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13338,"mutex_wait_us":109,"thread_start_us":14707,"threads_started":1}
I20260807 10:46:53.124692 2795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.102443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:40605 (local address 127.0.0.1:41568)
0807 10:46:53.114105 (+ 11662us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:53.114120 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:53.114254 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:53.114900 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:53.114905 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:53.114933 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:53.115536 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.115553 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.117540 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.117545 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.120322 (+ 2777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.120341 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.122517 (+ 2176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.122525 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.122693 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.122726 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:46:53.124164 (+ 1438us) client_negotiation.cc:240] Negotiation successful
0807 10:46:53.124332 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11544,"mutex_wait_us":109,"thread_start_us":11389,"threads_started":1}
I20260807 10:46:53.125098 2794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.100125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58540 (local address 127.11.46.129:37375)
0807 10:46:53.113874 (+ 13749us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.113883 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.113916 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:46:53.114031 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.114040 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.114318 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.114585 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:53.115518 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.117200 (+ 1682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.120555 (+ 3355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.121880 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.122011 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.122251 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.124541 (+ 2290us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.124692 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13560,"thread_start_us":13384,"threads_started":1}
I20260807 10:46:53.128217 2298 tablet_service.cc:1467] Processing CreateTablet for tablet 12a282ced1f74059b4c76ea97feb6d1d (DEFAULT_TABLE table=test-table [id=6d345cec15124b0badce9c2f14f03cde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:53.128249 2671 tablet_service.cc:1467] Processing CreateTablet for tablet 12a282ced1f74059b4c76ea97feb6d1d (DEFAULT_TABLE table=test-table [id=6d345cec15124b0badce9c2f14f03cde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:53.128544 2487 tablet_service.cc:1467] Processing CreateTablet for tablet 12a282ced1f74059b4c76ea97feb6d1d (DEFAULT_TABLE table=test-table [id=6d345cec15124b0badce9c2f14f03cde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:46:53.129788 2298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12a282ced1f74059b4c76ea97feb6d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:53.129868 2671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12a282ced1f74059b4c76ea97feb6d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:53.129870 2487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12a282ced1f74059b4c76ea97feb6d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:46:53.142977 2797 tablet_bootstrap.cc:492] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: Bootstrap starting.
I20260807 10:46:53.146126 2799 tablet_bootstrap.cc:492] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: Bootstrap starting.
I20260807 10:46:53.147553 2797 tablet_bootstrap.cc:654] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:53.148064 2798 tablet_bootstrap.cc:492] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: Bootstrap starting.
I20260807 10:46:53.149744 2797 log.cc:824] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:53.150197 2799 tablet_bootstrap.cc:654] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:53.151801 2799 log.cc:824] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:53.155495 2798 tablet_bootstrap.cc:654] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: Neither blocks nor log segments found. Creating new log.
I20260807 10:46:53.156466 2797 tablet_bootstrap.cc:492] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: No bootstrap required, opened a new log
I20260807 10:46:53.156908 2797 ts_tablet_manager.cc:1397] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.000s
I20260807 10:46:53.157270 2798 log.cc:824] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:46:53.157323 2799 tablet_bootstrap.cc:492] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: No bootstrap required, opened a new log
I20260807 10:46:53.157847 2799 ts_tablet_manager.cc:1397] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260807 10:46:53.164238 2798 tablet_bootstrap.cc:492] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: No bootstrap required, opened a new log
I20260807 10:46:53.164716 2798 ts_tablet_manager.cc:1397] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.006s
I20260807 10:46:53.167647 2799 raft_consensus.cc:348] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } }
I20260807 10:46:53.168125 2799 raft_consensus.cc:374] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:53.168267 2799 raft_consensus.cc:729] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7024955fd2a4011903d1efc52151561, State: Initialized, Role: FOLLOWER
I20260807 10:46:53.168047 2797 raft_consensus.cc:348] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } }
I20260807 10:46:53.168565 2797 raft_consensus.cc:374] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:53.168712 2797 raft_consensus.cc:729] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57109477fdd54dd4ba621fa68b60da54, State: Initialized, Role: FOLLOWER
I20260807 10:46:53.168996 2799 consensus_queue.cc:260] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } }
I20260807 10:46:53.169385 2797 consensus_queue.cc:260] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } }
I20260807 10:46:53.170449 2767 heartbeater.cc:503] Master 127.11.46.190:46599 was elected leader, sending a full tablet report...
I20260807 10:46:53.171108 2799 ts_tablet_manager.cc:1428] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: Time spent starting tablet: real 0.013s user 0.006s sys 0.005s
I20260807 10:46:53.173899 2797 ts_tablet_manager.cc:1428] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: Time spent starting tablet: real 0.017s user 0.014s sys 0.000s
I20260807 10:46:53.178431 2798 raft_consensus.cc:348] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } }
I20260807 10:46:53.178906 2798 raft_consensus.cc:374] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:46:53.179021 2798 raft_consensus.cc:729] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31c03620c5fc4836956710561ff9957f, State: Initialized, Role: FOLLOWER
I20260807 10:46:53.179729 2798 consensus_queue.cc:260] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } }
I20260807 10:46:53.181025 2573 heartbeater.cc:503] Master 127.11.46.190:46599 was elected leader, sending a full tablet report...
I20260807 10:46:53.181860 2798 ts_tablet_manager.cc:1428] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
W20260807 10:46:53.269220 2769 tablet.cc:2369] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:46:53.273278 2389 tablet.cc:2369] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:46:53.411665 2574 tablet.cc:2369] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:46:53.454763 2809 raft_consensus.cc:482] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:46:53.455128 2809 raft_consensus.cc:504] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } }
I20260807 10:46:53.457108 2809 leader_election.cc:288] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7024955fd2a4011903d1efc52151561 (127.11.46.131:35011), 57109477fdd54dd4ba621fa68b60da54 (127.11.46.129:37375)
I20260807 10:46:53.464771 2793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.457697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:51789 (local address 127.11.46.131:35011)
0807 10:46:53.457939 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.457946 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.458781 (+ 835us) server_negotiation.cc:407] Connection header received
0807 10:46:53.458978 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.458984 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.459061 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.459137 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:53.459826 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.460637 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.462821 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.463678 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.463856 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.463953 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.464345 (+ 392us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.464496 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 10:46:53.464780 2794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.457762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:41803 (local address 127.11.46.129:37375)
0807 10:46:53.457993 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.458000 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.458857 (+ 857us) server_negotiation.cc:407] Connection header received
0807 10:46:53.459033 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.459037 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.459103 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.459193 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:46:53.459957 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.460734 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.462860 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.463711 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.463883 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.463966 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.464365 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.464515 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:46:53.464957 2812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.457385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:35011 (local address 127.11.46.130:51789)
0807 10:46:53.458635 (+ 1250us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:53.458653 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:53.458817 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:53.459182 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:53.459187 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:53.459224 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:53.459664 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.459674 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.460822 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.460849 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.462641 (+ 1792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.462657 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.463944 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.463951 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.464115 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.464200 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 10:46:53.464292 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 10:46:53.464487 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1120,"mutex_wait_us":65,"thread_start_us":822,"threads_started":1}
I20260807 10:46:53.465000 2811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.457643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.11.46.130:41803)
0807 10:46:53.458704 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0807 10:46:53.458721 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:46:53.458877 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:46:53.459226 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:46:53.459230 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:46:53.459255 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:46:53.459776 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.459790 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.460877 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.460883 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.462680 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:46:53.462695 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.463989 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.463996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:46:53.464172 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.464216 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 10:46:53.464303 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 10:46:53.464484 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":951,"mutex_wait_us":63,"thread_start_us":507,"threads_started":1}
I20260807 10:46:53.466120 2696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12a282ced1f74059b4c76ea97feb6d1d" candidate_uuid: "31c03620c5fc4836956710561ff9957f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7024955fd2a4011903d1efc52151561" is_pre_election: true
I20260807 10:46:53.466158 2326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12a282ced1f74059b4c76ea97feb6d1d" candidate_uuid: "31c03620c5fc4836956710561ff9957f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57109477fdd54dd4ba621fa68b60da54" is_pre_election: true
I20260807 10:46:53.466681 2696 raft_consensus.cc:2454] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31c03620c5fc4836956710561ff9957f in term 0.
I20260807 10:46:53.466682 2326 raft_consensus.cc:2454] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31c03620c5fc4836956710561ff9957f in term 0.
I20260807 10:46:53.467401 2425 leader_election.cc:302] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31c03620c5fc4836956710561ff9957f, 57109477fdd54dd4ba621fa68b60da54; no voters:
I20260807 10:46:53.467921 2809 raft_consensus.cc:2781] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:46:53.468140 2809 raft_consensus.cc:482] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:46:53.468258 2809 raft_consensus.cc:3037] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:53.470741 2809 raft_consensus.cc:504] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } }
I20260807 10:46:53.471462 2809 leader_election.cc:288] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [CANDIDATE]: Term 1 election: Requested vote from peers a7024955fd2a4011903d1efc52151561 (127.11.46.131:35011), 57109477fdd54dd4ba621fa68b60da54 (127.11.46.129:37375)
I20260807 10:46:53.472040 2696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12a282ced1f74059b4c76ea97feb6d1d" candidate_uuid: "31c03620c5fc4836956710561ff9957f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7024955fd2a4011903d1efc52151561"
I20260807 10:46:53.472069 2326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12a282ced1f74059b4c76ea97feb6d1d" candidate_uuid: "31c03620c5fc4836956710561ff9957f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57109477fdd54dd4ba621fa68b60da54"
I20260807 10:46:53.472265 2696 raft_consensus.cc:3037] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:53.472280 2326 raft_consensus.cc:3037] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:46:53.474849 2326 raft_consensus.cc:2454] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31c03620c5fc4836956710561ff9957f in term 1.
I20260807 10:46:53.475298 2696 raft_consensus.cc:2454] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31c03620c5fc4836956710561ff9957f in term 1.
I20260807 10:46:53.475400 2425 leader_election.cc:302] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31c03620c5fc4836956710561ff9957f, 57109477fdd54dd4ba621fa68b60da54; no voters:
I20260807 10:46:53.475773 2809 raft_consensus.cc:2781] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:46:53.476285 2809 raft_consensus.cc:686] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 1 LEADER]: Becoming Leader. State: Replica: 31c03620c5fc4836956710561ff9957f, State: Running, Role: LEADER
I20260807 10:46:53.476847 2809 consensus_queue.cc:237] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } }
I20260807 10:46:53.481889 2123 catalog_manager.cc:5495] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f reported cstate change: term changed from 0 to 1, leader changed from <none> to 31c03620c5fc4836956710561ff9957f (127.11.46.130). New cstate: current_term: 1 leader_uuid: "31c03620c5fc4836956710561ff9957f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } health_report { overall_health: HEALTHY } } }
I20260807 10:46:53.570674 2796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.565171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41584 (local address 127.11.46.130:40605)
0807 10:46:53.565357 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.565362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.565414 (+ 52us) server_negotiation.cc:407] Connection header received
0807 10:46:53.565635 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.565639 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.565741 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.565875 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:46:53.566186 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.566950 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.568480 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.568921 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.569041 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.569560 (+ 519us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:46:53.570129 (+ 569us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:46:53.570243 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.570328 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.570411 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:46:53.579677 2696 raft_consensus.cc:1261] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561 [term 1 FOLLOWER]: Refusing update from remote peer 31c03620c5fc4836956710561ff9957f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:46:53.579677 2326 raft_consensus.cc:1261] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54 [term 1 FOLLOWER]: Refusing update from remote peer 31c03620c5fc4836956710561ff9957f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:46:53.580783 2813 consensus_queue.cc:1035] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:46:53.581214 2809 consensus_queue.cc:1035] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:46:53.593917 2816 mvcc.cc:205] Tried to move back new op lower bound from 7315864017211441152 to 7315864016805527552. Current Snapshot: MvccSnapshot[applied={T|T < 7315864017211441152}]
I20260807 10:46:53.610383 2122 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:46:53.610677 2122 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:46:53.614825 2122 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Sending DeleteTablet for 3 replicas of tablet 12a282ced1f74059b4c76ea97feb6d1d
I20260807 10:46:53.616220 2671 tablet_service.cc:1514] Processing DeleteTablet for tablet 12a282ced1f74059b4c76ea97feb6d1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:53 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:44290
I20260807 10:46:53.616246 2487 tablet_service.cc:1514] Processing DeleteTablet for tablet 12a282ced1f74059b4c76ea97feb6d1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:53 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:41568
I20260807 10:46:53.616243 2298 tablet_service.cc:1514] Processing DeleteTablet for tablet 12a282ced1f74059b4c76ea97feb6d1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:46:53 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:58540
I20260807 10:46:53.619199 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 2209
I20260807 10:46:53.629101 2836 tablet_replica.cc:330] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: stopping tablet replica
I20260807 10:46:53.630658 2836 raft_consensus.cc:2229] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:46:53.632527 2836 raft_consensus.cc:2258] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:53.636879 2836 ts_tablet_manager.cc:1905] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:53.637850 2832 tablet_replica.cc:330] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: stopping tablet replica
I20260807 10:46:53.638464 2832 raft_consensus.cc:2229] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:46:53.639196 2832 raft_consensus.cc:2258] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:53.640839 2837 tablet_replica.cc:330] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: stopping tablet replica
I20260807 10:46:53.641371 2837 raft_consensus.cc:2229] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:46:53.642091 2837 raft_consensus.cc:2258] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:46:53.645074 2837 ts_tablet_manager.cc:1905] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:53.645639 2832 ts_tablet_manager.cc:1905] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:46:53.649022 2836 ts_tablet_manager.cc:1918] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:53.649369 2836 log.cc:1196] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/12a282ced1f74059b4c76ea97feb6d1d
I20260807 10:46:53.650153 2836 ts_tablet_manager.cc:1939] T 12a282ced1f74059b4c76ea97feb6d1d P 31c03620c5fc4836956710561ff9957f: Deleting consensus metadata
I20260807 10:46:53.652585 2105 catalog_manager.cc:4841] TS 31c03620c5fc4836956710561ff9957f (127.11.46.130:40605): tablet 12a282ced1f74059b4c76ea97feb6d1d (table test-table [id=6d345cec15124b0badce9c2f14f03cde]) successfully deleted
I20260807 10:46:53.652920 2832 ts_tablet_manager.cc:1918] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:53.652964 2837 ts_tablet_manager.cc:1918] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:46:53.653301 2837 log.cc:1196] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/12a282ced1f74059b4c76ea97feb6d1d
I20260807 10:46:53.653951 2837 ts_tablet_manager.cc:1939] T 12a282ced1f74059b4c76ea97feb6d1d P a7024955fd2a4011903d1efc52151561: Deleting consensus metadata
I20260807 10:46:53.655674 2832 log.cc:1196] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/12a282ced1f74059b4c76ea97feb6d1d
Aug 07 10:46:53 dist-test-slave-42z9 krb5kdc[2056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:46:53.656234 2103 catalog_manager.cc:4841] TS a7024955fd2a4011903d1efc52151561 (127.11.46.131:35011): tablet 12a282ced1f74059b4c76ea97feb6d1d (table test-table [id=6d345cec15124b0badce9c2f14f03cde]) successfully deleted
I20260807 10:46:53.656324 2832 ts_tablet_manager.cc:1939] T 12a282ced1f74059b4c76ea97feb6d1d P 57109477fdd54dd4ba621fa68b60da54: Deleting consensus metadata
I20260807 10:46:53.658332 2102 catalog_manager.cc:4841] TS 57109477fdd54dd4ba621fa68b60da54 (127.11.46.129:37375): tablet 12a282ced1f74059b4c76ea97feb6d1d (table test-table [id=6d345cec15124b0badce9c2f14f03cde]) successfully deleted
I20260807 10:46:53.665426 2794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.620708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58554 (local address 127.11.46.129:37375)
0807 10:46:53.620917 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.620924 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.633768 (+ 12844us) server_negotiation.cc:407] Connection header received
0807 10:46:53.634408 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.634415 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.634523 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.634611 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:53.636975 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.638244 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.641634 (+ 3390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.642348 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.642490 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.657706 (+ 15216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:53.657728 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:53.657753 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:53.657812 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:53.661923 (+ 4111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:53.663010 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:53.663023 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:53.663027 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:53.663232 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:53.663612 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:53.663617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:53.663620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:53.664164 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:53.664508 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.664744 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.665007 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:46:53.666185 2381 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:53.760213 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 2209
I20260807 10:46:53.788805 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 2402
Aug 07 10:46:53 dist-test-slave-42z9 krb5kdc[2056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:46:53.808508 2796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.789642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41600 (local address 127.11.46.130:40605)
0807 10:46:53.789852 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.789857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.789952 (+ 95us) server_negotiation.cc:407] Connection header received
0807 10:46:53.790159 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.790164 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.790235 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.790322 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:53.791802 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.792706 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.794429 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.794925 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.795082 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.800188 (+ 5106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:53.800223 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:53.800249 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:53.800340 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:53.804796 (+ 4456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:53.805891 (+ 1095us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:53.805901 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:53.805904 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:53.806159 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:53.806625 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:53.806630 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:53.806638 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:53.807107 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:53.807501 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.807838 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.808115 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 10:46:53.809309 2566 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:53.930593 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 2402
I20260807 10:46:53.961756 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 2580
Aug 07 10:46:53 dist-test-slave-42z9 krb5kdc[2056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:46:53.978592 2793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:46:53.962586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44292 (local address 127.11.46.131:35011)
0807 10:46:53.962784 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 10:46:53.962789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:46:53.962837 (+ 48us) server_negotiation.cc:407] Connection header received
0807 10:46:53.963059 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:46:53.963065 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:46:53.963138 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:46:53.963239 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:46:53.964628 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.965362 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.966927 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:46:53.967353 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:46:53.967464 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:46:53.972347 (+ 4883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:46:53.972366 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:46:53.972386 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:46:53.972437 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:46:53.975529 (+ 3092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:53.976349 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:53.976358 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:53.976360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:53.976536 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:46:53.976919 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:46:53.976924 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:46:53.976926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:46:53.977321 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:46:53.977656 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0807 10:46:53.977990 (+ 334us) server_negotiation.cc:299] Negotiation successful
0807 10:46:53.978229 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:46:53.979290 2759 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:54.071727 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 2580
I20260807 10:46:54.098307 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 2077
I20260807 10:46:54.099677 2162 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:46:54.216004 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 2077
I20260807 10:47:14.250869 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:46599
--webserver_interface=127.11.46.190
--webserver_port=37009
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:46599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:47:14.646847 2845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:14.647198 2845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:14.647342 2845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:14.655083 2845 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 10:47:14.655200 2845 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 10:47:14.655274 2845 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 10:47:14.655349 2845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:47:14.655423 2845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:14.655522 2845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:14.655593 2845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:47:14.655670 2845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:47:14.666319 2845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:46599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:46599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=37009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:14.667834 2845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:14.669364 2845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 10:47:14.699550 2845 server_base.cc:1034] running on GCE node
W20260807 10:47:14.699489 2853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:14.699540 2854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:14.700016 2857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:14.701401 2845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:14.703449 2845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:14.704735 2845 hybrid_clock.cc:648] HybridClock initialized: now 1786099634704648 us; error 71 us; skew 500 ppm
I20260807 10:47:14.705214 2845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:14 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099634, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:14.712577 2845 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:47:14.714800 2845 webserver.cc:460] Webserver started at http://127.11.46.190:37009/ using document root <none> and password file <none>
I20260807 10:47:14.715814 2845 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:14.715981 2845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:14.723564 2845 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 10:47:14.727355 2868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:14.729164 2845 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:47:14.729414 2845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "a3431eaa7aec42e399c214739d2cd73a"
format_stamp: "Formatted at 2026-08-07 10:46:50 on dist-test-slave-42z9"
server_key: "bffd927760edb54458f662ac53763534"
server_key_iv: "5c15289c82c0cef10334e2a35b4dba94"
server_key_version: "encryptionkey@0"
I20260807 10:47:14.730700 2845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:14.748860 2845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:14.753939 2845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:14.754281 2845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:14.776377 2845 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:46599
I20260807 10:47:14.776393 2938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:46599 every 8 connection(s)
I20260807 10:47:14.778386 2845 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:47:14.784382 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 2845
I20260807 10:47:14.785552 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:37375
--local_ip_for_outbound_sockets=127.11.46.129
--tserver_master_addrs=127.11.46.190:46599
--webserver_port=34667
--webserver_interface=127.11.46.129
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:47:14.787858 2942 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:47:14.793031 2942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Bootstrap starting.
I20260807 10:47:14.817771 2942 log.cc:824] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:47:14.833353 2942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:47:14.834040 2942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Bootstrap complete.
I20260807 10:47:14.844412 2942 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:47:14.845379 2942 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3431eaa7aec42e399c214739d2cd73a, State: Initialized, Role: FOLLOWER
I20260807 10:47:14.846150 2942 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:47:14.846403 2942 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:47:14.846540 2942 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:47:14.846719 2942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:47:14.851046 2942 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:47:14.851861 2942 leader_election.cc:302] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3431eaa7aec42e399c214739d2cd73a; no voters:
I20260807 10:47:14.852739 2942 leader_election.cc:288] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 10:47:14.852944 2948 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 10:47:14.855240 2948 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 2 LEADER]: Becoming Leader. State: Replica: a3431eaa7aec42e399c214739d2cd73a, State: Running, Role: LEADER
I20260807 10:47:14.856155 2948 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:47:14.858367 2948 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3431eaa7aec42e399c214739d2cd73a. Latest consensus state: current_term: 2 leader_uuid: "a3431eaa7aec42e399c214739d2cd73a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } } }
I20260807 10:47:14.859746 2948 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: This master's current role is: LEADER
I20260807 10:47:14.860250 2950 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a3431eaa7aec42e399c214739d2cd73a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } } }
I20260807 10:47:14.860702 2950 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: This master's current role is: LEADER
I20260807 10:47:14.861644 2942 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:47:14.866084 2954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:47:14.876343 2954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:47:14.878578 2954 catalog_manager.cc:1259] Loaded cluster ID: bdd4aa46217d44fd8af8aebb8f41595e
I20260807 10:47:14.878852 2954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:47:14.883845 2954 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:47:14.886129 2954 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Loaded TSK: 0
I20260807 10:47:14.908676 2972 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 10:47:14.922303 2954 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Generated new TSK 1
I20260807 10:47:14.922856 2954 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 10:47:15.231314 2945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:15.231719 2945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:15.231869 2945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:15.240108 2945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:15.240281 2945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:15.240444 2945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:47:15.251375 2945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:37375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=34667
--tserver_master_addrs=127.11.46.190:46599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:15.253003 2945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:15.254644 2945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:15.271139 2984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:15.271178 2983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:15.271862 2988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:15.272903 2945 server_base.cc:1034] running on GCE node
I20260807 10:47:15.273837 2945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:15.275398 2945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:15.276685 2945 hybrid_clock.cc:648] HybridClock initialized: now 1786099635276617 us; error 58 us; skew 500 ppm
I20260807 10:47:15.277144 2945 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:15 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:15.281716 2945 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:47:15.283833 2945 webserver.cc:460] Webserver started at http://127.11.46.129:34667/ using document root <none> and password file <none>
I20260807 10:47:15.284845 2945 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:15.285034 2945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:15.292444 2945 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:47:15.295740 2995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:15.297372 2945 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 10:47:15.297647 2945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "57109477fdd54dd4ba621fa68b60da54"
format_stamp: "Formatted at 2026-08-07 10:46:51 on dist-test-slave-42z9"
server_key: "b83325c39ec826da51355f7d8c26cd0d"
server_key_iv: "e0d46e97b125d7a0dbc6177ee5ddfcea"
server_key_version: "encryptionkey@0"
I20260807 10:47:15.298755 2945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:15.316845 2945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:15.321504 2945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:15.321800 2945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:15.322956 2945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:47:15.324546 2945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:47:15.324667 2945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:15.324788 2945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:47:15.324867 2945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:15.360769 2945 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:37375
I20260807 10:47:15.360868 3157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:37375 every 8 connection(s)
I20260807 10:47:15.362572 2945 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:47:15.368306 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 2945
I20260807 10:47:15.368996 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:40605
--local_ip_for_outbound_sockets=127.11.46.130
--tserver_master_addrs=127.11.46.190:46599
--webserver_port=36847
--webserver_interface=127.11.46.130
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:47:15 dist-test-slave-42z9 krb5kdc[2056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:47:15.391479 3162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:15.366154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:53707)
0807 10:47:15.367018 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:15.367060 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:15.368962 (+ 1902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:15.370945 (+ 1983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:15.370955 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:15.371563 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:47:15.372161 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:15.372183 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:15.374522 (+ 2339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:15.374527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:15.375896 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:15.375914 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:15.377543 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:15.377553 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:15.377785 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:15.378542 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:47:15.378574 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:47:15.381561 (+ 2987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:47:15.386063 (+ 4502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:15.386075 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:15.386096 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:15.386874 (+ 778us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:15.387523 (+ 649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:15.387529 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:15.387533 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:15.387871 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:15.389123 (+ 1252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:47:15.389133 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:47:15.389576 (+ 443us) client_negotiation.cc:769] Sending connection context
0807 10:47:15.389860 (+ 284us) client_negotiation.cc:240] Negotiation successful
0807 10:47:15.390352 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":343,"threads_started":1}
I20260807 10:47:15.391829 3160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:15.365951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:53707 (local address 127.11.46.190:46599)
0807 10:47:15.366564 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:15.366584 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:15.367210 (+ 626us) server_negotiation.cc:407] Connection header received
0807 10:47:15.369764 (+ 2554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:15.369783 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:15.370304 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:15.370774 (+ 470us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:15.372409 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:15.374261 (+ 1852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:15.376125 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:15.377210 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:15.377485 (+ 275us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:15.382004 (+ 4519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:15.382017 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:15.382043 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:15.382103 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:15.385770 (+ 3667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:15.387051 (+ 1281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:15.387060 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:15.387068 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:15.387313 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:15.388047 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:15.388054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:15.388057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:15.388890 (+ 833us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:15.389150 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:15.390143 (+ 993us) server_negotiation.cc:299] Negotiation successful
0807 10:47:15.390637 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":233,"threads_started":1}
I20260807 10:47:15.394893 3158 heartbeater.cc:347] Connected to a master server at 127.11.46.190:46599
I20260807 10:47:15.395308 3158 heartbeater.cc:464] Registering TS with master...
I20260807 10:47:15.396348 3158 heartbeater.cc:511] Master 127.11.46.190:46599 requested a full tablet report, sending...
I20260807 10:47:15.399151 2890 ts_manager.cc:194] Registered new tserver with Master: 57109477fdd54dd4ba621fa68b60da54 (127.11.46.129:37375)
I20260807 10:47:15.400782 2890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:53707
W20260807 10:47:15.771646 3163 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:15.772001 3163 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:15.772168 3163 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:15.782764 3163 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:15.782954 3163 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:15.783169 3163 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:47:15.800297 3163 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:40605
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=36847
--tserver_master_addrs=127.11.46.190:46599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:15.801949 3163 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:15.803493 3163 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:15.819041 3171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:15.819080 3170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:15.819118 3173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:15.820014 3163 server_base.cc:1034] running on GCE node
I20260807 10:47:15.820791 3163 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:15.821978 3163 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:15.823223 3163 hybrid_clock.cc:648] HybridClock initialized: now 1786099635823163 us; error 47 us; skew 500 ppm
I20260807 10:47:15.823624 3163 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:15 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:15.827220 3163 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:47:15.829046 3163 webserver.cc:460] Webserver started at http://127.11.46.130:36847/ using document root <none> and password file <none>
I20260807 10:47:15.829965 3163 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:15.830132 3163 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:15.837105 3163 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:47:15.840663 3183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:15.842383 3163 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 10:47:15.842628 3163 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "31c03620c5fc4836956710561ff9957f"
format_stamp: "Formatted at 2026-08-07 10:46:52 on dist-test-slave-42z9"
server_key: "1b46d7e63d61bf3129fe1d19899d97ea"
server_key_iv: "84518f6570706f9bb0292d3162db7b54"
server_key_version: "encryptionkey@0"
I20260807 10:47:15.843797 3163 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:15.866888 3163 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:15.871872 3163 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:15.872190 3163 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:15.873492 3163 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:47:15.875169 3163 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:47:15.875289 3163 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:15.875425 3163 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:47:15.875501 3163 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:15.911298 3163 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:40605
I20260807 10:47:15.911361 3338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:40605 every 8 connection(s)
I20260807 10:47:15.912989 3163 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:47:15.914422 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 3163
I20260807 10:47:15.915267 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:35011
--local_ip_for_outbound_sockets=127.11.46.131
--tserver_master_addrs=127.11.46.190:46599
--webserver_port=39239
--webserver_interface=127.11.46.131
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 10:47:15 dist-test-slave-42z9 krb5kdc[2056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:47:15.939399 3341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:15.916294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:38155 (local address 127.11.46.190:46599)
0807 10:47:15.916821 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:15.916827 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:15.918165 (+ 1338us) server_negotiation.cc:407] Connection header received
0807 10:47:15.920791 (+ 2626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:15.920796 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:15.920912 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:15.921021 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:15.923603 (+ 2582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:15.924364 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:15.926816 (+ 2452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:15.927278 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:15.927410 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:15.932328 (+ 4918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:15.932335 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:15.932340 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:15.932386 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:15.935631 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:15.936636 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:15.936643 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:15.936647 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:15.936858 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:15.937337 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:15.937342 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:15.937345 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:15.937775 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:15.937930 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:15.938740 (+ 810us) server_negotiation.cc:299] Negotiation successful
0807 10:47:15.939014 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":249,"threads_started":1}
I20260807 10:47:15.940375 3342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:15.916967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:38155)
0807 10:47:15.917938 (+ 971us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:15.917993 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:15.920389 (+ 2396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:15.921375 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:15.921388 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:15.922340 (+ 952us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:47:15.923316 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:15.923353 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:15.924574 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:15.924580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:15.926624 (+ 2044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:15.926648 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:15.927582 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:15.927591 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:15.927908 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:15.928791 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:47:15.928835 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:47:15.931956 (+ 3121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:47:15.935832 (+ 3876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:15.935842 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:15.935860 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:15.936453 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:15.936979 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:15.936982 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:15.936985 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:15.937208 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:15.937899 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:47:15.937907 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:47:15.938323 (+ 416us) client_negotiation.cc:769] Sending connection context
0807 10:47:15.938590 (+ 267us) client_negotiation.cc:240] Negotiation successful
0807 10:47:15.939070 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":376,"threads_started":1}
I20260807 10:47:15.942031 3339 heartbeater.cc:347] Connected to a master server at 127.11.46.190:46599
I20260807 10:47:15.942368 3339 heartbeater.cc:464] Registering TS with master...
I20260807 10:47:15.943174 3339 heartbeater.cc:511] Master 127.11.46.190:46599 requested a full tablet report, sending...
I20260807 10:47:15.944787 2890 ts_manager.cc:194] Registered new tserver with Master: 31c03620c5fc4836956710561ff9957f (127.11.46.130:40605)
I20260807 10:47:15.945703 2890 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:38155
W20260807 10:47:16.313856 3343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:16.314206 3343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:16.314388 3343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:16.322427 3343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:16.322585 3343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:16.322749 3343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:47:16.333534 3343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:35011
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=39239
--tserver_master_addrs=127.11.46.190:46599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:16.335261 3343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:16.336999 3343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:16.352406 3356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:16.352342 3354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:16.352403 3353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:16.353430 3343 server_base.cc:1034] running on GCE node
I20260807 10:47:16.354216 3343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:16.355391 3343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:16.356633 3343 hybrid_clock.cc:648] HybridClock initialized: now 1786099636356577 us; error 46 us; skew 500 ppm
I20260807 10:47:16.356994 3343 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:16 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099636, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:16.360600 3343 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:47:16.362483 3343 webserver.cc:460] Webserver started at http://127.11.46.131:39239/ using document root <none> and password file <none>
I20260807 10:47:16.363294 3343 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:16.363457 3343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:16.370182 3343 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:47:16.373638 3370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:16.375471 3343 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:47:16.375689 3343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "a7024955fd2a4011903d1efc52151561"
format_stamp: "Formatted at 2026-08-07 10:46:52 on dist-test-slave-42z9"
server_key: "e15456f5dd92e495cb493eb019ea9c94"
server_key_iv: "d1ef79a4b527a014da12cdaf01eb1eab"
server_key_version: "encryptionkey@0"
I20260807 10:47:16.376910 3343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:16.393730 3343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:16.398825 3343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:16.399145 3343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:16.400367 3343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:47:16.402135 3343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:47:16.402248 3343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:16.402365 3343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:47:16.402438 3343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:16.405716 3158 heartbeater.cc:503] Master 127.11.46.190:46599 was elected leader, sending a full tablet report...
I20260807 10:47:16.437079 3343 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:35011
I20260807 10:47:16.437145 3519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:35011 every 8 connection(s)
I20260807 10:47:16.438824 3343 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:47:16.448531 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 3343
Aug 07 10:47:16 dist-test-slave-42z9 krb5kdc[2056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099636, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:47:16.464787 3523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.441882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:60701 (local address 127.11.46.190:46599)
0807 10:47:16.442357 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.442362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.443568 (+ 1206us) server_negotiation.cc:407] Connection header received
0807 10:47:16.445688 (+ 2120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.445694 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.445812 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.445927 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:16.447970 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.449100 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.451445 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.452098 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.452256 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.456886 (+ 4630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:16.456892 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:16.456897 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:16.456944 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:16.460467 (+ 3523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:16.461747 (+ 1280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:16.461753 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:16.461755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:16.461938 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:16.462698 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:16.462702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:16.462705 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:16.463190 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:16.463381 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:16.464273 (+ 892us) server_negotiation.cc:299] Negotiation successful
0807 10:47:16.464483 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":243,"threads_started":1}
I20260807 10:47:16.466554 3524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.442560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:60701)
0807 10:47:16.443371 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:16.443434 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:16.445270 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:16.446281 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:16.446293 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:16.446997 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:47:16.447711 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.447734 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.449382 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.449390 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.451284 (+ 1894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.451303 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.452339 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.452344 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.452580 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.453504 (+ 924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:47:16.453544 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:47:16.456593 (+ 3049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:47:16.460671 (+ 4078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:16.460685 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:16.460710 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:16.461575 (+ 865us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:16.462094 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:16.462099 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:16.462103 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:16.462484 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:16.463371 (+ 887us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:47:16.463379 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:47:16.463831 (+ 452us) client_negotiation.cc:769] Sending connection context
0807 10:47:16.464121 (+ 290us) client_negotiation.cc:240] Negotiation successful
0807 10:47:16.464802 (+ 681us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":291,"threads_started":1}
I20260807 10:47:16.467463 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.449779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42378 (local address 127.11.46.190:46599)
0807 10:47:16.450369 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.450374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.450660 (+ 286us) server_negotiation.cc:407] Connection header received
0807 10:47:16.450839 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.450845 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.450951 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.451050 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:16.453268 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.454581 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.456207 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.456651 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.456756 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.460721 (+ 3965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:16.460728 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:16.460733 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:16.460778 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:16.464058 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:16.465123 (+ 1065us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:16.465129 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:16.465132 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:16.465295 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:16.465777 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:16.465782 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:16.465785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:16.466187 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:16.466490 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:16.466823 (+ 333us) server_negotiation.cc:299] Negotiation successful
0807 10:47:16.467098 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":277,"threads_started":1}
I20260807 10:47:16.468818 3520 heartbeater.cc:347] Connected to a master server at 127.11.46.190:46599
I20260807 10:47:16.469228 3520 heartbeater.cc:464] Registering TS with master...
I20260807 10:47:16.470263 3520 heartbeater.cc:511] Master 127.11.46.190:46599 requested a full tablet report, sending...
I20260807 10:47:16.472080 2888 ts_manager.cc:194] Registered new tserver with Master: a7024955fd2a4011903d1efc52151561 (127.11.46.131:35011)
I20260807 10:47:16.473078 2888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:60701
I20260807 10:47:16.483839 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:47:16.491407 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.484938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42380 (local address 127.11.46.190:46599)
0807 10:47:16.485130 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.485135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.485676 (+ 541us) server_negotiation.cc:407] Connection header received
0807 10:47:16.485945 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.485951 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.486181 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.486332 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:47:16.486848 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.487578 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.489133 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.489707 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.489822 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.490437 (+ 615us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:47:16.490776 (+ 339us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 10:47:16.491131 (+ 355us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42380: token expired
Metrics: {"server-negotiator.queue_time_us":55}
W20260807 10:47:16.491531 3525 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42380: token expired
W20260807 10:47:16.492202 2777 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.46.190:46599)
I20260807 10:47:16.506774 3525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.492754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42382 (local address 127.11.46.190:46599)
0807 10:47:16.492921 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.492925 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.492943 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:47:16.493084 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.493087 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.493152 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.493233 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:16.494766 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.495547 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.497190 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.497699 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.497820 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.501009 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:16.501015 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:16.501019 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:16.501067 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:16.503934 (+ 2867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:16.504719 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:16.504723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:16.504726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:16.504905 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:16.505204 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:16.505207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:16.505209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:16.505634 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:16.505836 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:16.506149 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 10:47:16.506361 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 10:47:16.510725 2888 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42382:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:47:16.518674 2888 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:47:16.560840 3543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.533113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46540 (local address 127.11.46.129:37375)
0807 10:47:16.551426 (+ 18313us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.551437 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.552440 (+ 1003us) server_negotiation.cc:407] Connection header received
0807 10:47:16.552706 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.552714 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.552913 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.553136 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:47:16.554118 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.555566 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.558260 (+ 2694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.559513 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.559662 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.559935 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:16.560333 (+ 398us) server_negotiation.cc:299] Negotiation successful
0807 10:47:16.560530 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18028,"thread_start_us":17868,"threads_started":1}
I20260807 10:47:16.561079 3540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.532763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.0.0.1:46540)
0807 10:47:16.552288 (+ 19525us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:16.552310 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:16.552474 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:16.553508 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:16.553513 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:16.553541 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:47:16.553941 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.553965 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.555713 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.555718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.558005 (+ 2287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.558025 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.559783 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.559791 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.560035 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.560087 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 10:47:16.560217 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 10:47:16.560438 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19361,"mutex_wait_us":88,"thread_start_us":18892,"threads_started":1}
I20260807 10:47:16.561952 3544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.532357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:40605 (local address 127.0.0.1:49628)
0807 10:47:16.550292 (+ 17935us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:16.550342 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:16.550742 (+ 400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:16.552728 (+ 1986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:16.552736 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:16.552765 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:47:16.553180 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.553194 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.555351 (+ 2157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.555356 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.558405 (+ 3049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.558426 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.560937 (+ 2511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.560945 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.561155 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.561229 (+ 74us) client_negotiation.cc:769] Sending connection context
0807 10:47:16.561330 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 10:47:16.561529 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17593,"mutex_wait_us":242,"thread_start_us":19683,"threads_started":1}
I20260807 10:47:16.562146 3546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.533834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41918 (local address 127.11.46.131:35011)
0807 10:47:16.550214 (+ 16380us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.550225 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.552550 (+ 2325us) server_negotiation.cc:407] Connection header received
0807 10:47:16.552674 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.552682 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.552913 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.553132 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:47:16.553823 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.555150 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.558665 (+ 3515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.560306 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.560449 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.560683 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:16.561510 (+ 827us) server_negotiation.cc:299] Negotiation successful
0807 10:47:16.561721 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16174,"thread_start_us":16393,"threads_started":1}
I20260807 10:47:16.562923 3539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.532571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49628 (local address 127.11.46.130:40605)
0807 10:47:16.533792 (+ 1221us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.533803 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.550507 (+ 16704us) server_negotiation.cc:407] Connection header received
0807 10:47:16.552066 (+ 1559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.552076 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.552415 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.552617 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:47:16.553507 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.555199 (+ 1692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.558699 (+ 3500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.560306 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.560449 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.560658 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:16.562322 (+ 1664us) server_negotiation.cc:299] Negotiation successful
0807 10:47:16.562562 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1000,"spinlock_wait_cycles":27008,"thread_start_us":966,"threads_started":1}
I20260807 10:47:16.563125 3538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.533299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:35011 (local address 127.0.0.1:41918)
0807 10:47:16.552363 (+ 19064us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:16.552389 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:16.552532 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:16.553121 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:16.553129 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:16.553158 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:47:16.553571 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.553585 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.555298 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.555304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.558405 (+ 3101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.558426 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.561017 (+ 2591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.561025 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.561245 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.561272 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 10:47:16.561334 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 10:47:16.562735 (+ 1401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18918,"mutex_wait_us":1451,"thread_start_us":16006,"threads_started":1}
I20260807 10:47:16.565840 3068 tablet_service.cc:1467] Processing CreateTablet for tablet c517c78e2927417ebfdffa915ad1f323 (DEFAULT_TABLE table=test-table [id=af3279c95c24465e99811d0e6e5ec5b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:47:16.567355 3068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c517c78e2927417ebfdffa915ad1f323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:47:16.566975 3250 tablet_service.cc:1467] Processing CreateTablet for tablet c517c78e2927417ebfdffa915ad1f323 (DEFAULT_TABLE table=test-table [id=af3279c95c24465e99811d0e6e5ec5b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:47:16.568313 3250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c517c78e2927417ebfdffa915ad1f323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:47:16.572885 3441 tablet_service.cc:1467] Processing CreateTablet for tablet c517c78e2927417ebfdffa915ad1f323 (DEFAULT_TABLE table=test-table [id=af3279c95c24465e99811d0e6e5ec5b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:47:16.576665 3441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c517c78e2927417ebfdffa915ad1f323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:47:16.580564 3547 tablet_bootstrap.cc:492] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Bootstrap starting.
I20260807 10:47:16.584676 3547 tablet_bootstrap.cc:654] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Neither blocks nor log segments found. Creating new log.
I20260807 10:47:16.585273 3548 tablet_bootstrap.cc:492] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: Bootstrap starting.
I20260807 10:47:16.587157 3547 log.cc:824] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Log is configured to *not* fsync() on all Append() calls
I20260807 10:47:16.589414 3548 tablet_bootstrap.cc:654] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: Neither blocks nor log segments found. Creating new log.
I20260807 10:47:16.591037 3548 log.cc:824] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:47:16.591284 3547 tablet_bootstrap.cc:492] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: No bootstrap required, opened a new log
I20260807 10:47:16.591653 3547 ts_tablet_manager.cc:1397] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260807 10:47:16.594144 3552 tablet_bootstrap.cc:492] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: Bootstrap starting.
I20260807 10:47:16.596570 3548 tablet_bootstrap.cc:492] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: No bootstrap required, opened a new log
I20260807 10:47:16.596943 3548 ts_tablet_manager.cc:1397] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260807 10:47:16.598606 3552 tablet_bootstrap.cc:654] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: Neither blocks nor log segments found. Creating new log.
I20260807 10:47:16.601016 3552 log.cc:824] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: Log is configured to *not* fsync() on all Append() calls
I20260807 10:47:16.601073 3547 raft_consensus.cc:348] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } }
I20260807 10:47:16.601624 3547 raft_consensus.cc:374] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:47:16.601756 3547 raft_consensus.cc:729] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57109477fdd54dd4ba621fa68b60da54, State: Initialized, Role: FOLLOWER
I20260807 10:47:16.602487 3547 consensus_queue.cc:260] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } }
I20260807 10:47:16.604573 3547 ts_tablet_manager.cc:1428] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260807 10:47:16.608776 3552 tablet_bootstrap.cc:492] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: No bootstrap required, opened a new log
I20260807 10:47:16.608399 3548 raft_consensus.cc:348] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } }
I20260807 10:47:16.608939 3548 raft_consensus.cc:374] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:47:16.609053 3548 raft_consensus.cc:729] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31c03620c5fc4836956710561ff9957f, State: Initialized, Role: FOLLOWER
I20260807 10:47:16.609153 3552 ts_tablet_manager.cc:1397] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260807 10:47:16.609838 3548 consensus_queue.cc:260] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } }
I20260807 10:47:16.611394 3339 heartbeater.cc:503] Master 127.11.46.190:46599 was elected leader, sending a full tablet report...
I20260807 10:47:16.612258 3548 ts_tablet_manager.cc:1428] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: Time spent starting tablet: real 0.015s user 0.013s sys 0.003s
W20260807 10:47:16.615216 3159 tablet.cc:2369] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:47:16.619318 3552 raft_consensus.cc:348] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } }
I20260807 10:47:16.619827 3552 raft_consensus.cc:374] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:47:16.619913 3552 raft_consensus.cc:729] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7024955fd2a4011903d1efc52151561, State: Initialized, Role: FOLLOWER
I20260807 10:47:16.620536 3552 consensus_queue.cc:260] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } }
I20260807 10:47:16.621791 3520 heartbeater.cc:503] Master 127.11.46.190:46599 was elected leader, sending a full tablet report...
I20260807 10:47:16.622383 3552 ts_tablet_manager.cc:1428] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: Time spent starting tablet: real 0.013s user 0.009s sys 0.004s
W20260807 10:47:16.665318 3340 tablet.cc:2369] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:47:16.690728 3521 tablet.cc:2369] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:47:16.856036 3556 raft_consensus.cc:482] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:47:16.856431 3556 raft_consensus.cc:504] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } }
I20260807 10:47:16.858736 3556 leader_election.cc:288] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 57109477fdd54dd4ba621fa68b60da54 (127.11.46.129:37375), a7024955fd2a4011903d1efc52151561 (127.11.46.131:35011)
I20260807 10:47:16.868407 3546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.860486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:53089 (local address 127.11.46.131:35011)
0807 10:47:16.860742 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.860749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.860776 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:47:16.861197 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.861206 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.861361 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.861495 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:47:16.862311 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.863402 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.866090 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.867373 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.867579 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.867665 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:16.867983 (+ 318us) server_negotiation.cc:299] Negotiation successful
0807 10:47:16.868142 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260807 10:47:16.868443 3560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.859082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:35011 (local address 127.11.46.130:53089)
0807 10:47:16.860576 (+ 1494us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:16.860658 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:16.860885 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:16.861726 (+ 841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:16.861731 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:16.861765 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:47:16.862160 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.862171 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.863557 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.863561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.865892 (+ 2331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.865912 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.867630 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.867636 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.867791 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.867835 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 10:47:16.867918 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 10:47:16.868053 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1264,"mutex_wait_us":2,"thread_start_us":988,"threads_started":1}
I20260807 10:47:16.868957 3561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.859366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.11.46.130:46183)
0807 10:47:16.861714 (+ 2348us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:16.861732 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:16.861935 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:16.862300 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:16.862303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:16.862325 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:47:16.862715 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.862728 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.863978 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.863984 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.866112 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:16.866124 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.868036 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.868043 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:16.868240 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.868277 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:47:16.868382 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 10:47:16.868544 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2216,"mutex_wait_us":34,"thread_start_us":1919,"threads_started":1}
I20260807 10:47:16.869424 3543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.860878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:46183 (local address 127.11.46.129:37375)
0807 10:47:16.861124 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.861130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.861810 (+ 680us) server_negotiation.cc:407] Connection header received
0807 10:47:16.862088 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.862093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.862174 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.862263 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:47:16.862893 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.863844 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.866290 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.867610 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.867786 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.867840 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:16.868445 (+ 605us) server_negotiation.cc:299] Negotiation successful
0807 10:47:16.868658 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 10:47:16.869971 3464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c517c78e2927417ebfdffa915ad1f323" candidate_uuid: "31c03620c5fc4836956710561ff9957f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7024955fd2a4011903d1efc52151561" is_pre_election: true
I20260807 10:47:16.870419 3095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c517c78e2927417ebfdffa915ad1f323" candidate_uuid: "31c03620c5fc4836956710561ff9957f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57109477fdd54dd4ba621fa68b60da54" is_pre_election: true
I20260807 10:47:16.870574 3464 raft_consensus.cc:2454] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31c03620c5fc4836956710561ff9957f in term 0.
I20260807 10:47:16.870946 3095 raft_consensus.cc:2454] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31c03620c5fc4836956710561ff9957f in term 0.
I20260807 10:47:16.871340 3185 leader_election.cc:302] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31c03620c5fc4836956710561ff9957f, a7024955fd2a4011903d1efc52151561; no voters:
I20260807 10:47:16.871821 3556 raft_consensus.cc:2781] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:47:16.871958 3556 raft_consensus.cc:482] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:47:16.872069 3556 raft_consensus.cc:3037] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:47:16.874503 3556 raft_consensus.cc:504] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } }
I20260807 10:47:16.875305 3556 leader_election.cc:288] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [CANDIDATE]: Term 1 election: Requested vote from peers 57109477fdd54dd4ba621fa68b60da54 (127.11.46.129:37375), a7024955fd2a4011903d1efc52151561 (127.11.46.131:35011)
I20260807 10:47:16.875914 3095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c517c78e2927417ebfdffa915ad1f323" candidate_uuid: "31c03620c5fc4836956710561ff9957f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "57109477fdd54dd4ba621fa68b60da54"
I20260807 10:47:16.875914 3464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c517c78e2927417ebfdffa915ad1f323" candidate_uuid: "31c03620c5fc4836956710561ff9957f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7024955fd2a4011903d1efc52151561"
I20260807 10:47:16.876173 3464 raft_consensus.cc:3037] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:47:16.876171 3095 raft_consensus.cc:3037] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:47:16.879675 3095 raft_consensus.cc:2454] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31c03620c5fc4836956710561ff9957f in term 1.
I20260807 10:47:16.879675 3464 raft_consensus.cc:2454] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31c03620c5fc4836956710561ff9957f in term 1.
I20260807 10:47:16.880376 3184 leader_election.cc:302] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 31c03620c5fc4836956710561ff9957f, 57109477fdd54dd4ba621fa68b60da54, a7024955fd2a4011903d1efc52151561; no voters:
I20260807 10:47:16.880829 3556 raft_consensus.cc:2781] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:47:16.881330 3556 raft_consensus.cc:686] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 1 LEADER]: Becoming Leader. State: Replica: 31c03620c5fc4836956710561ff9957f, State: Running, Role: LEADER
I20260807 10:47:16.881966 3556 consensus_queue.cc:237] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } } peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } }
I20260807 10:47:16.887245 2890 catalog_manager.cc:5495] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f reported cstate change: term changed from 0 to 1, leader changed from <none> to 31c03620c5fc4836956710561ff9957f (127.11.46.130). New cstate: current_term: 1 leader_uuid: "31c03620c5fc4836956710561ff9957f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c03620c5fc4836956710561ff9957f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 40605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 } health_report { overall_health: UNKNOWN } } }
I20260807 10:47:16.917598 3539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.910870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49630 (local address 127.11.46.130:40605)
0807 10:47:16.911162 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.911168 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.911191 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:47:16.911312 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.911318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.911440 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.911624 (+ 184us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:47:16.912026 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.913192 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.914759 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.915468 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.915617 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.916167 (+ 550us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:47:16.916867 (+ 700us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:47:16.917031 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:16.917143 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 10:47:16.917247 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260807 10:47:16.928090 3464 raft_consensus.cc:1261] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561 [term 1 FOLLOWER]: Refusing update from remote peer 31c03620c5fc4836956710561ff9957f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:47:16.928090 3095 raft_consensus.cc:1261] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54 [term 1 FOLLOWER]: Refusing update from remote peer 31c03620c5fc4836956710561ff9957f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:47:16.929301 3556 consensus_queue.cc:1035] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [LEADER]: Connected to new peer: Peer: permanent_uuid: "57109477fdd54dd4ba621fa68b60da54" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:47:16.929690 3564 consensus_queue.cc:1035] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7024955fd2a4011903d1efc52151561" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:47:16.943339 3570 mvcc.cc:205] Tried to move back new op lower bound from 7315864112844038144 to 7315864112672956416. Current Snapshot: MvccSnapshot[applied={T|T < 7315864112844038144}]
I20260807 10:47:16.944355 3569 mvcc.cc:205] Tried to move back new op lower bound from 7315864112844038144 to 7315864112672956416. Current Snapshot: MvccSnapshot[applied={T|T < 7315864112844038144}]
I20260807 10:47:16.958596 2890 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42382:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:47:16.958899 2890 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42382:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:47:16.963090 2890 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Sending DeleteTablet for 3 replicas of tablet c517c78e2927417ebfdffa915ad1f323
I20260807 10:47:16.964560 3068 tablet_service.cc:1514] Processing DeleteTablet for tablet c517c78e2927417ebfdffa915ad1f323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:47:16 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:46540
I20260807 10:47:16.964576 3250 tablet_service.cc:1514] Processing DeleteTablet for tablet c517c78e2927417ebfdffa915ad1f323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:47:16 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:49628
I20260807 10:47:16.964663 3441 tablet_service.cc:1514] Processing DeleteTablet for tablet c517c78e2927417ebfdffa915ad1f323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:47:16 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:41918
I20260807 10:47:16.966670 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 2945
I20260807 10:47:16.985345 3587 tablet_replica.cc:330] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: stopping tablet replica
I20260807 10:47:16.986147 3587 raft_consensus.cc:2229] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:47:16.986903 3587 raft_consensus.cc:2258] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:47:16.987969 3585 tablet_replica.cc:330] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: stopping tablet replica
I20260807 10:47:16.990444 3587 ts_tablet_manager.cc:1905] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:47:16.991107 3585 raft_consensus.cc:2229] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:47:16.998092 3585 raft_consensus.cc:2258] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:47:17.001315 3585 ts_tablet_manager.cc:1905] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:47:17.002163 3586 tablet_replica.cc:330] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: stopping tablet replica
I20260807 10:47:17.002764 3586 raft_consensus.cc:2229] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:47:17.004066 3587 ts_tablet_manager.cc:1918] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:47:17.004348 3587 log.cc:1196] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/c517c78e2927417ebfdffa915ad1f323
I20260807 10:47:17.005133 3587 ts_tablet_manager.cc:1939] T c517c78e2927417ebfdffa915ad1f323 P a7024955fd2a4011903d1efc52151561: Deleting consensus metadata
I20260807 10:47:17.006299 3543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:16.968668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46556 (local address 127.11.46.129:37375)
0807 10:47:16.968881 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:16.968888 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:16.983704 (+ 14816us) server_negotiation.cc:407] Connection header received
0807 10:47:16.983932 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:16.983939 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:16.984047 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:16.984177 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:16.987914 (+ 3737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.989261 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.991729 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:16.992445 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:16.992585 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:16.997033 (+ 4448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:16.997058 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:16.997085 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:16.997152 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:17.001750 (+ 4598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:17.002972 (+ 1222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:17.002983 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:17.002987 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:17.003212 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:17.003865 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:17.003870 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:17.003873 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:17.004475 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:17.004824 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:17.005586 (+ 762us) server_negotiation.cc:299] Negotiation successful
0807 10:47:17.005884 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:47:17.007923 3152 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:47:17.008389 3586 raft_consensus.cc:2258] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:47:17.009691 2870 catalog_manager.cc:4841] TS a7024955fd2a4011903d1efc52151561 (127.11.46.131:35011): tablet c517c78e2927417ebfdffa915ad1f323 (table test-table [id=af3279c95c24465e99811d0e6e5ec5b6]) successfully deleted
I20260807 10:47:17.011132 3586 ts_tablet_manager.cc:1905] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:47:17.019569 3586 ts_tablet_manager.cc:1918] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:47:17.019842 3586 log.cc:1196] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/c517c78e2927417ebfdffa915ad1f323
I20260807 10:47:17.020562 3586 ts_tablet_manager.cc:1939] T c517c78e2927417ebfdffa915ad1f323 P 31c03620c5fc4836956710561ff9957f: Deleting consensus metadata
I20260807 10:47:17.022879 2872 catalog_manager.cc:4841] TS 31c03620c5fc4836956710561ff9957f (127.11.46.130:40605): tablet c517c78e2927417ebfdffa915ad1f323 (table test-table [id=af3279c95c24465e99811d0e6e5ec5b6]) successfully deleted
I20260807 10:47:17.103889 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 2945
I20260807 10:47:17.143851 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 3163
W20260807 10:47:17.143759 2869 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.46.129:37375 (error 108)
I20260807 10:47:17.146216 3593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:17.145308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.0.0.1:46564)
0807 10:47:17.145808 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:17.145961 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:37375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":261,"threads_started":1}
W20260807 10:47:17.146565 2869 catalog_manager.cc:4584] TS 57109477fdd54dd4ba621fa68b60da54 (127.11.46.129:37375): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c517c78e2927417ebfdffa915ad1f323: Network error: Client connection negotiation failed: client connection to 127.11.46.129:37375: connect: Connection refused (error 111)
I20260807 10:47:17.163487 3539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:17.144992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49642 (local address 127.11.46.130:40605)
0807 10:47:17.145216 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:17.145223 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:17.145245 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:47:17.145315 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:17.145319 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:17.145428 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:17.145568 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:17.147529 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:17.148881 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:17.150569 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:17.151330 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:17.151503 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:17.155218 (+ 3715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:17.155243 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:17.155269 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:17.155325 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:17.160093 (+ 4768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:17.160992 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:17.161005 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:17.161009 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:17.161214 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:17.161645 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:17.161651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:17.161654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:17.162236 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:17.162615 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:17.162796 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 10:47:17.163071 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:47:17.164511 3334 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:47:17.200388 3593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:17.199762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.0.0.1:46566)
0807 10:47:17.200051 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:17.200194 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:37375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260807 10:47:17.201716 3593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:17.201228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.0.0.1:46572)
0807 10:47:17.201393 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:17.201514 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:37375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 10:47:17.262660 3593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:17.262150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.0.0.1:46582)
0807 10:47:17.262355 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:17.262475 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:37375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 10:47:17.263825 3593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:17.263445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.0.0.1:46586)
0807 10:47:17.263579 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:17.263663 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:37375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 10:47:17.287062 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 3163
I20260807 10:47:17.322038 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 3343
I20260807 10:47:17.337172 3546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:17.322899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41924 (local address 127.11.46.131:35011)
0807 10:47:17.323123 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:17.323129 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:17.323154 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:47:17.323260 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:17.323265 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:17.323350 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:17.323443 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:17.324969 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:17.325852 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:17.327271 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:17.327705 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:17.327833 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:17.330923 (+ 3090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:17.330944 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:17.330964 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:17.331011 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:17.334098 (+ 3087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:17.335033 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:17.335042 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:17.335045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:17.335213 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:17.335591 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:17.335594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:17.335596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:17.336073 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:17.336335 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:17.336619 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 10:47:17.336818 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 10:47:17.337982 3512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:47:17.344723 3593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:17.344202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.0.0.1:46590)
0807 10:47:17.344445 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:17.344549 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:37375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 10:47:17.346009 3593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:17.345532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.0.0.1:46598)
0807 10:47:17.345752 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:17.345841 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:37375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260807 10:47:17.430382 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 3343
I20260807 10:47:17.459885 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 2845
I20260807 10:47:17.461136 2932 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:47:17.582473 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 2845
I20260807 10:47:17.582543 3593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:17.581655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:37375 (local address 127.0.0.1:46608)
0807 10:47:17.582018 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:17.582328 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:37375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260807 10:47:37.622135 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:46599
--webserver_interface=127.11.46.190
--webserver_port=37009
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:46599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:47:38.015805 3599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:38.016162 3599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:38.016260 3599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:38.024024 3599 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 10:47:38.024174 3599 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 10:47:38.024228 3599 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 10:47:38.024282 3599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:47:38.024343 3599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:38.024416 3599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:38.024463 3599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:47:38.024519 3599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:47:38.035622 3599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:46599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:46599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=37009
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:38.037093 3599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:38.038689 3599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:38.051514 3607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:38.051563 3611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:38.051589 3606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:38.052747 3599 server_base.cc:1034] running on GCE node
I20260807 10:47:38.053743 3599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:38.055444 3599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:38.056712 3599 hybrid_clock.cc:648] HybridClock initialized: now 1786099658056619 us; error 50 us; skew 500 ppm
I20260807 10:47:38.057102 3599 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:38 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099658, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:38.064343 3599 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:47:38.066144 3599 webserver.cc:460] Webserver started at http://127.11.46.190:37009/ using document root <none> and password file <none>
I20260807 10:47:38.066968 3599 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:38.067083 3599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:38.073253 3599 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 10:47:38.076586 3619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:38.078354 3599 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:47:38.078594 3599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "a3431eaa7aec42e399c214739d2cd73a"
format_stamp: "Formatted at 2026-08-07 10:46:50 on dist-test-slave-42z9"
server_key: "bffd927760edb54458f662ac53763534"
server_key_iv: "5c15289c82c0cef10334e2a35b4dba94"
server_key_version: "encryptionkey@0"
I20260807 10:47:38.079720 3599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:38.093526 3599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:38.098218 3599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:38.098542 3599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:38.119635 3599 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:46599
I20260807 10:47:38.119657 3682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:46599 every 8 connection(s)
I20260807 10:47:38.121510 3599 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:47:38.129664 3684 sys_catalog.cc:263] Verifying existing consensus state
I20260807 10:47:38.131915 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 3599
I20260807 10:47:38.132926 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:37375
--local_ip_for_outbound_sockets=127.11.46.129
--tserver_master_addrs=127.11.46.190:46599
--webserver_port=34667
--webserver_interface=127.11.46.129
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:47:38.133704 3684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Bootstrap starting.
I20260807 10:47:38.157174 3684 log.cc:824] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:47:38.176430 3684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 10:47:38.177068 3684 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Bootstrap complete.
I20260807 10:47:38.187485 3684 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:47:38.188529 3684 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3431eaa7aec42e399c214739d2cd73a, State: Initialized, Role: FOLLOWER
I20260807 10:47:38.189220 3684 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:47:38.189507 3684 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:47:38.189637 3684 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:47:38.189814 3684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 2 FOLLOWER]: Advancing to term 3
I20260807 10:47:38.194250 3684 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:47:38.194878 3684 leader_election.cc:302] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3431eaa7aec42e399c214739d2cd73a; no voters:
I20260807 10:47:38.195577 3684 leader_election.cc:288] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 10:47:38.195829 3689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 10:47:38.196748 3689 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [term 3 LEADER]: Becoming Leader. State: Replica: a3431eaa7aec42e399c214739d2cd73a, State: Running, Role: LEADER
I20260807 10:47:38.197484 3689 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } }
I20260807 10:47:38.197850 3684 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:47:38.200357 3692 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3431eaa7aec42e399c214739d2cd73a. Latest consensus state: current_term: 3 leader_uuid: "a3431eaa7aec42e399c214739d2cd73a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } } }
I20260807 10:47:38.200835 3692 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: This master's current role is: LEADER
I20260807 10:47:38.201500 3690 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "a3431eaa7aec42e399c214739d2cd73a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3431eaa7aec42e399c214739d2cd73a" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46599 } } }
I20260807 10:47:38.201826 3690 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a [sys.catalog]: This master's current role is: LEADER
I20260807 10:47:38.211341 3698 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:47:38.221421 3698 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:47:38.223371 3698 catalog_manager.cc:1259] Loaded cluster ID: bdd4aa46217d44fd8af8aebb8f41595e
I20260807 10:47:38.223574 3698 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:47:38.228037 3698 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:47:38.230173 3698 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Loaded TSK: 0
I20260807 10:47:38.230456 3698 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a3431eaa7aec42e399c214739d2cd73a: Loaded TSK: 1
F20260807 10:47:38.231715 3698 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe4a97099ad google::LogMessage::Fail() at ??:0
@ 0x7fe4a970c88a google::LogMessage::SendToLog() at ??:0
@ 0x7fe4a97094de google::LogMessage::Flush() at ??:0
@ 0x7fe4a970aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe4ad46d7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fe4ad45c73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fe4bf13c1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fe4bf13b783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fe4bf1c72a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fe4bf1c70c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fe4bf2115e9 std::function<>::operator()() at ??:0
@ 0x7fe4bf13fcdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fe4bf13dc36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe4bf1c5610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fe4bf1c5439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fe4ac355345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe4ac35891c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fe4ac358799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fe4ac333eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe4af60d6db start_thread at ??:0
@ 0x7fe4a85a361f clone at ??:0
W20260807 10:47:38.609961 3686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:38.610301 3686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:38.610406 3686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:38.618338 3686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:38.618492 3686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:38.618623 3686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:47:38.629390 3686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:37375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=34667
--tserver_master_addrs=127.11.46.190:46599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:38.630930 3686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:38.632494 3686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:38.650005 3746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:38.650032 3751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:38.649951 3748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:38.651062 3686 server_base.cc:1034] running on GCE node
I20260807 10:47:38.651834 3686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:38.652976 3686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:38.654199 3686 hybrid_clock.cc:648] HybridClock initialized: now 1786099658654145 us; error 44 us; skew 500 ppm
I20260807 10:47:38.654592 3686 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:38 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099658, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:38.658332 3686 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:47:38.660308 3686 webserver.cc:460] Webserver started at http://127.11.46.129:34667/ using document root <none> and password file <none>
I20260807 10:47:38.661211 3686 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:38.661366 3686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:38.668134 3686 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:47:38.671990 3758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:38.673837 3686 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:47:38.674053 3686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "57109477fdd54dd4ba621fa68b60da54"
format_stamp: "Formatted at 2026-08-07 10:46:51 on dist-test-slave-42z9"
server_key: "b83325c39ec826da51355f7d8c26cd0d"
server_key_iv: "e0d46e97b125d7a0dbc6177ee5ddfcea"
server_key_version: "encryptionkey@0"
I20260807 10:47:38.675186 3686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:38.700734 3686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:38.705864 3686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:38.706182 3686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:38.707336 3686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:47:38.709681 3773 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260807 10:47:38.716069 3773 ts_tablet_manager.cc:1852] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260807 10:47:38.717175 3773 ts_tablet_manager.cc:1905] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:47:38.725797 3773 ts_tablet_manager.cc:1918] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:47:38.726074 3773 log.cc:1196] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/c517c78e2927417ebfdffa915ad1f323
I20260807 10:47:38.726629 3773 ts_tablet_manager.cc:1939] T c517c78e2927417ebfdffa915ad1f323 P 57109477fdd54dd4ba621fa68b60da54: Deleting consensus metadata
I20260807 10:47:38.727238 3686 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260807 10:47:38.727385 3686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.018s user 0.001s sys 0.000s
I20260807 10:47:38.727532 3686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:47:38.727617 3686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:38.763553 3686 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:37375
I20260807 10:47:38.763607 3938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:37375 every 8 connection(s)
I20260807 10:47:38.765053 3686 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:47:38.771242 3941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:38.768690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:43117)
0807 10:47:38.769693 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:38.769989 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":344,"threads_started":1}
W20260807 10:47:38.772159 3939 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:46599 (0 consecutive failures): Network error: Failed to ping master at 127.11.46.190:46599: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
I20260807 10:47:38.773373 3941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:38.772950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:33241)
0807 10:47:38.773133 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:38.773220 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 10:47:38.774513 3941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:38.774031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:47019)
0807 10:47:38.774202 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:38.774313 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 10:47:38.774986 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 3686
W20260807 10:47:38.775033 3939 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 10:47:38.775756 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:40605
--local_ip_for_outbound_sockets=127.11.46.130
--tserver_master_addrs=127.11.46.190:46599
--webserver_port=36847
--webserver_interface=127.11.46.130
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:47:39.171464 3942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:39.171799 3942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:39.171940 3942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:39.179836 3942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:39.179981 3942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:39.180145 3942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:47:39.190927 3942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:40605
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=36847
--tserver_master_addrs=127.11.46.190:46599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:39.192464 3942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:39.194094 3942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:39.208563 3953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:39.208606 3947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:39.208630 3949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:39.209478 3942 server_base.cc:1034] running on GCE node
I20260807 10:47:39.210233 3942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:39.211364 3942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:39.212594 3942 hybrid_clock.cc:648] HybridClock initialized: now 1786099659212540 us; error 49 us; skew 500 ppm
I20260807 10:47:39.212961 3942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:39 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099659, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:39.216351 3942 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:47:39.218066 3942 webserver.cc:460] Webserver started at http://127.11.46.130:36847/ using document root <none> and password file <none>
I20260807 10:47:39.218837 3942 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:39.218981 3942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:39.225212 3942 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 10:47:39.228439 3961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:39.230014 3942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:47:39.230216 3942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "31c03620c5fc4836956710561ff9957f"
format_stamp: "Formatted at 2026-08-07 10:46:52 on dist-test-slave-42z9"
server_key: "1b46d7e63d61bf3129fe1d19899d97ea"
server_key_iv: "84518f6570706f9bb0292d3162db7b54"
server_key_version: "encryptionkey@0"
I20260807 10:47:39.231315 3942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:39.260776 3942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:39.265013 3942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:39.265313 3942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:39.266422 3942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:47:39.267863 3942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:47:39.267983 3942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:39.268096 3942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:47:39.268184 3942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:39.301311 3942 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:40605
I20260807 10:47:39.301370 4134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:40605 every 8 connection(s)
I20260807 10:47:39.302912 3942 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:47:39.305843 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 3942
I20260807 10:47:39.306531 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:35011
--local_ip_for_outbound_sockets=127.11.46.131
--tserver_master_addrs=127.11.46.190:46599
--webserver_port=39239
--webserver_interface=127.11.46.131
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:39201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:47:39.308722 4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:39.306167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:41409)
0807 10:47:39.307091 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:39.307423 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":353,"threads_started":1}
W20260807 10:47:39.309543 4135 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:46599 (0 consecutive failures): Network error: Failed to ping master at 127.11.46.190:46599: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
I20260807 10:47:39.310534 4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:39.310120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:38417)
0807 10:47:39.310294 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:39.310383 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 10:47:39.311503 4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:39.311108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:56793)
0807 10:47:39.311258 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:39.311353 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 10:47:39.311782 4135 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 10:47:39.683262 4140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:39.683589 4140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:39.683738 4140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:39.691426 4140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:39.691584 4140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:39.691753 4140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:47:39.702490 4140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:35011
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=39239
--tserver_master_addrs=127.11.46.190:46599
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:39.704020 4140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:39.705549 4140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:39.720211 4149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:39.720276 4146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:39.720310 4147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:39.721182 4140 server_base.cc:1034] running on GCE node
I20260807 10:47:39.721961 4140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:39.723078 4140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:39.724298 4140 hybrid_clock.cc:648] HybridClock initialized: now 1786099659724224 us; error 62 us; skew 500 ppm
I20260807 10:47:39.724678 4140 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:39 dist-test-slave-42z9 krb5kdc[2056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099659, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:39.728262 4140 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:47:39.730100 4140 webserver.cc:460] Webserver started at http://127.11.46.131:39239/ using document root <none> and password file <none>
I20260807 10:47:39.730918 4140 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:39.731056 4140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:39.737303 4140 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260807 10:47:39.740504 4157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:39.742166 4140 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:47:39.742374 4140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "a7024955fd2a4011903d1efc52151561"
format_stamp: "Formatted at 2026-08-07 10:46:52 on dist-test-slave-42z9"
server_key: "e15456f5dd92e495cb493eb019ea9c94"
server_key_iv: "d1ef79a4b527a014da12cdaf01eb1eab"
server_key_version: "encryptionkey@0"
I20260807 10:47:39.743506 4140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:39.763927 4140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:39.768582 4140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:39.768860 4140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:39.770009 4140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:47:39.771588 4140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:47:39.771689 4140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:39.771811 4140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:47:39.771883 4140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:39.776646 4175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:39.775683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:45863)
0807 10:47:39.776220 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:39.776321 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":258,"threads_started":1}
I20260807 10:47:39.806187 4140 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:35011
I20260807 10:47:39.806269 4322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:35011 every 8 connection(s)
I20260807 10:47:39.807744 4140 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:47:39.812963 4327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:39.810874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:40285)
0807 10:47:39.811717 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:39.811990 (+ 273us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":319,"threads_started":1}
W20260807 10:47:39.813763 4323 heartbeater.cc:644] Failed to heartbeat to 127.11.46.190:46599 (0 consecutive failures): Network error: Failed to ping master at 127.11.46.190:46599: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
I20260807 10:47:39.814697 4327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:39.814336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:41985)
0807 10:47:39.814495 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:39.814570 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 10:47:39.815424 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 4140
I20260807 10:47:39.815668 4327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:39.815234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:43235)
0807 10:47:39.815402 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:39.815516 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 10:47:39.815948 4323 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 10:47:40.314029 4329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:40.312505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:36767)
0807 10:47:40.313426 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:40.313662 (+ 236us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":424,"threads_started":1}
I20260807 10:47:40.778645 4331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:40.777845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:46721)
0807 10:47:40.778376 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:40.778472 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":281,"threads_started":1}
I20260807 10:47:40.817533 4333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:40.816632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:46107)
0807 10:47:40.817117 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:40.817242 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":220,"threads_started":1}
I20260807 10:47:41.316226 4335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:41.315401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:57341)
0807 10:47:41.315926 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:41.316030 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":252,"threads_started":1}
I20260807 10:47:41.780757 4336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:41.779768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:47617)
0807 10:47:41.780378 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:41.780510 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":263,"threads_started":1}
I20260807 10:47:41.819319 4340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:41.818551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:38379)
0807 10:47:41.819043 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:41.819136 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":235,"threads_started":1}
I20260807 10:47:42.318140 4341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:42.317281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:40627)
0807 10:47:42.317821 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:42.317936 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":299,"threads_started":1}
I20260807 10:47:42.782686 4343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:42.781812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:50993)
0807 10:47:42.782393 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:42.782501 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":313,"threads_started":1}
I20260807 10:47:42.821281 4345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:42.820422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:54183)
0807 10:47:42.820976 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:42.821084 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":284,"threads_started":1}
I20260807 10:47:43.320145 4346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:43.319257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:46663)
0807 10:47:43.319837 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:43.319937 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":320,"threads_started":1}
I20260807 10:47:43.784720 4350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:43.783844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:35723)
0807 10:47:43.784418 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:43.784519 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":292,"threads_started":1}
I20260807 10:47:43.823187 4351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:43.822425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:57109)
0807 10:47:43.822877 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:43.822968 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":214,"threads_started":1}
I20260807 10:47:44.322252 4352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:44.321331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:36737)
0807 10:47:44.321932 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:44.322050 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":309,"threads_started":1}
I20260807 10:47:44.786832 4353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:44.785976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:59939)
0807 10:47:44.786549 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:44.786652 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":302,"threads_started":1}
I20260807 10:47:44.825197 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:44.824289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:56729)
0807 10:47:44.824883 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:44.824978 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":313,"threads_started":1}
I20260807 10:47:45.324376 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:45.323486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:33565)
0807 10:47:45.324077 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:45.324192 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":315,"threads_started":1}
I20260807 10:47:45.788899 4356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:45.787913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:49915)
0807 10:47:45.788576 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:45.788670 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":273,"threads_started":1}
I20260807 10:47:45.827098 4362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:45.826276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:59593)
0807 10:47:45.826809 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:45.826914 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":250,"threads_started":1}
I20260807 10:47:46.326509 4363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:46.325607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:34747)
0807 10:47:46.326168 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:46.326263 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":246,"threads_started":1}
I20260807 10:47:46.790915 4364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:46.790034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:45379)
0807 10:47:46.790612 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:46.790712 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":296,"threads_started":1}
I20260807 10:47:46.829046 4365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:46.828144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:40359)
0807 10:47:46.828700 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:46.828799 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":238,"threads_started":1}
I20260807 10:47:47.328418 4366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:47.327577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:56887)
0807 10:47:47.328136 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:47.328236 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":287,"threads_started":1}
I20260807 10:47:47.793047 4367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:47.792163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:51893)
0807 10:47:47.792741 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:47.792854 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":294,"threads_started":1}
I20260807 10:47:47.830948 4368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:47.830097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:33635)
0807 10:47:47.830640 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:47.830741 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":288,"threads_started":1}
I20260807 10:47:48.330215 4369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:48.329392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:44919)
0807 10:47:48.329936 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:48.330028 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":283,"threads_started":1}
I20260807 10:47:48.794849 4371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:48.794079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:41959)
0807 10:47:48.794565 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:48.794659 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":248,"threads_started":1}
I20260807 10:47:48.832809 4373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:48.831927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:52115)
0807 10:47:48.832518 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:48.832614 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":280,"threads_started":1}
I20260807 10:47:49.332139 4376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:49.331318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:52321)
0807 10:47:49.331831 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:49.331933 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":278,"threads_started":1}
I20260807 10:47:49.796806 4377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:49.795946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:57649)
0807 10:47:49.796476 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:49.796581 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":279,"threads_started":1}
I20260807 10:47:49.834780 4378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:49.833935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:47751)
0807 10:47:49.834473 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:49.834578 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":265,"threads_started":1}
I20260807 10:47:50.334247 4379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:50.333378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:33179)
0807 10:47:50.333937 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:50.334050 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":297,"threads_started":1}
I20260807 10:47:50.798604 4380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:50.797801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:44471)
0807 10:47:50.798321 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:50.798418 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":283,"threads_started":1}
I20260807 10:47:50.836661 4381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:50.835814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:41617)
0807 10:47:50.836342 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:50.836454 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":327,"threads_started":1}
I20260807 10:47:51.336238 4383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:51.335432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:54863)
0807 10:47:51.335951 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:51.336055 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":242,"threads_started":1}
I20260807 10:47:51.800513 4384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:51.799648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:56351)
0807 10:47:51.800179 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:51.800300 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":266,"threads_started":1}
I20260807 10:47:51.838930 4385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:51.837781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:54843)
0807 10:47:51.838545 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:51.838696 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":371,"threads_started":1}
I20260807 10:47:52.338239 4387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:52.337335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:50811)
0807 10:47:52.337909 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:52.338023 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":288,"threads_started":1}
I20260807 10:47:52.802486 4388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:52.801602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:58685)
0807 10:47:52.802145 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:52.802247 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":257,"threads_started":1}
I20260807 10:47:52.841154 4389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:52.840210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:48565)
0807 10:47:52.840801 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:52.840927 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":286,"threads_started":1}
I20260807 10:47:53.340186 4390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:53.339294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:49975)
0807 10:47:53.339885 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:53.339986 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":306,"threads_started":1}
I20260807 10:47:53.804718 4391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:53.803855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:53397)
0807 10:47:53.804394 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:53.804517 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":272,"threads_started":1}
I20260807 10:47:53.843173 4392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:53.842252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:54317)
0807 10:47:53.842855 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:53.842965 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":345,"threads_started":1}
I20260807 10:47:54.342384 4393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:54.341501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.130:48275)
0807 10:47:54.342041 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:54.342162 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":278,"threads_started":1}
I20260807 10:47:54.806668 4394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:54.805845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.129:41915)
0807 10:47:54.806380 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:54.806480 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":271,"threads_started":1}
I20260807 10:47:54.826505 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 3686
I20260807 10:47:54.845350 4397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:54.844401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:46599 (local address 127.11.46.131:40843)
0807 10:47:54.845066 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:54.845161 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.190:46599: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":438,"threads_started":1}
I20260807 10:47:54.850915 4396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:54.827745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56408 (local address 127.11.46.129:37375)
0807 10:47:54.828567 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:54.828586 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:54.828639 (+ 53us) server_negotiation.cc:407] Connection header received
0807 10:47:54.830645 (+ 2006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:54.830659 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:54.831167 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:54.831495 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:54.833028 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:54.834417 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:54.835770 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:54.836549 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:54.836711 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:54.843758 (+ 7047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:54.843768 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:54.843788 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:54.843837 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:54.847285 (+ 3448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:54.848189 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:54.848198 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:54.848206 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:54.848412 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:54.848785 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:54.848788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:54.848790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:54.849417 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:54.849719 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:54.850130 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 10:47:54.850595 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":395,"threads_started":1}
I20260807 10:47:54.852456 3928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:47:54.941578 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 3686
I20260807 10:47:54.973614 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 3942
I20260807 10:47:54.993896 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:54.974621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50022 (local address 127.11.46.130:40605)
0807 10:47:54.975190 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:54.975206 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:54.975250 (+ 44us) server_negotiation.cc:407] Connection header received
0807 10:47:54.976912 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:54.976925 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:54.977480 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:54.977882 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:54.979631 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:54.980996 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:54.982417 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:54.983210 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:54.983423 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:54.986378 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:54.986389 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:54.986409 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:54.986466 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:54.990445 (+ 3979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:54.991235 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:54.991242 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:54.991250 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:54.991446 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:54.991799 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:54.991801 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:54.991803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:54.992395 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:54.992664 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:54.993073 (+ 409us) server_negotiation.cc:299] Negotiation successful
0807 10:47:54.993583 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":254,"threads_started":1}
I20260807 10:47:54.995561 4129 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:47:55.083928 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 3942
I20260807 10:47:55.114257 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 4140
I20260807 10:47:55.134932 4401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:55.115292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49800 (local address 127.11.46.131:35011)
0807 10:47:55.115911 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:55.115927 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:55.115976 (+ 49us) server_negotiation.cc:407] Connection header received
0807 10:47:55.117848 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:55.117863 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:55.118381 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:55.118757 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:55.120411 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:55.122165 (+ 1754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:55.123632 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:55.124414 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:55.124656 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:55.127709 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:55.127721 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:55.127743 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:55.127800 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:55.130924 (+ 3124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:55.131774 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:55.131784 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:55.131792 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:55.132027 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:55.132462 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:55.132467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:55.132469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:55.133135 (+ 666us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:55.133496 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:55.134060 (+ 564us) server_negotiation.cc:299] Negotiation successful
0807 10:47:55.134596 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":279,"threads_started":1}
I20260807 10:47:55.136618 4316 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:47:55.231182 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 4140
2026-08-07T10:47:55Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (66354 ms)
[----------] 30 tests from SecurityITest (320138 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:47:55 dist-test-slave-42z9 krb5kdc[4406](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:47:55 dist-test-slave-42z9 krb5kdc[4406](info): set up 2 sockets
Aug 07 10:47:55 dist-test-slave-42z9 krb5kdc[4406](info): commencing operation
krb5kdc: starting...
W20260807 10:47:56.503844 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.004s sys 0.063s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:47:56 dist-test-slave-42z9 krb5kdc[4406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:47:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:47:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:47:56.896690 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:45661
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:44611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:45661
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:47:57.289039 4425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:57.289431 4425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:57.289597 4425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:57.297361 4425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:47:57.297549 4425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:57.297636 4425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:57.297740 4425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:47:57.297799 4425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:47:57.308775 4425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:44611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:45661
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:45661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:57.310442 4425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:57.311987 4425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:57.325866 4433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:57.325789 4435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:57.325843 4438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:57.326756 4425 server_base.cc:1034] running on GCE node
I20260807 10:47:57.327718 4425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:57.329536 4425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:57.330802 4425 hybrid_clock.cc:648] HybridClock initialized: now 1786099677330735 us; error 59 us; skew 500 ppm
I20260807 10:47:57.331224 4425 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:57 dist-test-slave-42z9 krb5kdc[4406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099677, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:57.334892 4425 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:47:57.336825 4425 webserver.cc:460] Webserver started at http://127.11.46.190:33379/ using document root <none> and password file <none>
I20260807 10:47:57.337703 4425 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:57.337847 4425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:57.338168 4425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:47:57.341828 4425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "83467c54441e4cd8a005ce604fcfa134"
format_stamp: "Formatted at 2026-08-07 10:47:57 on dist-test-slave-42z9"
server_key: "096acd5cfe7a6daa5551a0f21acfceb1"
server_key_iv: "9bc784253aafdb47bc981947fa012098"
server_key_version: "encryptionkey@0"
I20260807 10:47:57.342726 4425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "83467c54441e4cd8a005ce604fcfa134"
format_stamp: "Formatted at 2026-08-07 10:47:57 on dist-test-slave-42z9"
server_key: "096acd5cfe7a6daa5551a0f21acfceb1"
server_key_iv: "9bc784253aafdb47bc981947fa012098"
server_key_version: "encryptionkey@0"
I20260807 10:47:57.349098 4425 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:47:57.353297 4446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:57.355084 4425 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:47:57.355329 4425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "83467c54441e4cd8a005ce604fcfa134"
format_stamp: "Formatted at 2026-08-07 10:47:57 on dist-test-slave-42z9"
server_key: "096acd5cfe7a6daa5551a0f21acfceb1"
server_key_iv: "9bc784253aafdb47bc981947fa012098"
server_key_version: "encryptionkey@0"
I20260807 10:47:57.355581 4425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:57.373860 4425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:57.378651 4425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:57.378981 4425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:57.399681 4425 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:45661
I20260807 10:47:57.399688 4516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:45661 every 8 connection(s)
I20260807 10:47:57.401407 4425 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:47:57.405848 4517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:47:57.406419 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 4425
I20260807 10:47:57.406657 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:47:57.407562 11450 external_mini_cluster.cc:1428] Setting key 2340e776d45047807f7b8ad830e5e49b
I20260807 10:47:57.421808 4517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134: Bootstrap starting.
Aug 07 10:47:57 dist-test-slave-42z9 krb5kdc[4406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:47:57.426155 4517 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134: Neither blocks nor log segments found. Creating new log.
I20260807 10:47:57.427491 4517 log.cc:824] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134: Log is configured to *not* fsync() on all Append() calls
I20260807 10:47:57.431532 4517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134: No bootstrap required, opened a new log
I20260807 10:47:57.435097 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:57.409957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37180 (local address 127.11.46.190:45661)
0807 10:47:57.410902 (+ 945us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:57.410919 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:57.410971 (+ 52us) server_negotiation.cc:407] Connection header received
0807 10:47:57.412935 (+ 1964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:57.412967 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:57.413492 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:57.413897 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:57.415946 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:57.417401 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:57.419472 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:57.420277 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:57.420432 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:57.425805 (+ 5373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:57.425815 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:57.425842 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:57.425901 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:57.429737 (+ 3836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:57.430665 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:57.430675 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:57.430687 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:57.430943 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:57.431320 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:57.431325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:57.431328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:57.432164 (+ 836us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:57.432503 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:57.432939 (+ 436us) server_negotiation.cc:299] Negotiation successful
0807 10:47:57.433523 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":709,"thread_start_us":458,"threads_started":1}
I20260807 10:47:57.440866 4517 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83467c54441e4cd8a005ce604fcfa134" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45661 } }
I20260807 10:47:57.441293 4517 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:47:57.441373 4517 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83467c54441e4cd8a005ce604fcfa134, State: Initialized, Role: FOLLOWER
I20260807 10:47:57.441995 4517 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83467c54441e4cd8a005ce604fcfa134" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45661 } }
I20260807 10:47:57.442236 4517 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:47:57.442342 4517 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:47:57.442487 4517 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:47:57.444825 4517 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83467c54441e4cd8a005ce604fcfa134" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45661 } }
I20260807 10:47:57.445401 4517 leader_election.cc:302] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83467c54441e4cd8a005ce604fcfa134; no voters:
I20260807 10:47:57.447710 4517 leader_election.cc:288] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:47:57.447850 4525 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:47:57.448585 4525 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [term 1 LEADER]: Becoming Leader. State: Replica: 83467c54441e4cd8a005ce604fcfa134, State: Running, Role: LEADER
I20260807 10:47:57.449280 4525 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83467c54441e4cd8a005ce604fcfa134" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45661 } }
I20260807 10:47:57.450523 4517 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:47:57.452579 4528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83467c54441e4cd8a005ce604fcfa134. Latest consensus state: current_term: 1 leader_uuid: "83467c54441e4cd8a005ce604fcfa134" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83467c54441e4cd8a005ce604fcfa134" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45661 } } }
I20260807 10:47:57.453001 4526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83467c54441e4cd8a005ce604fcfa134" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83467c54441e4cd8a005ce604fcfa134" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 45661 } } }
I20260807 10:47:57.453382 4526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [sys.catalog]: This master's current role is: LEADER
I20260807 10:47:57.453264 4528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134 [sys.catalog]: This master's current role is: LEADER
I20260807 10:47:57.454366 4537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:47:57.461378 4537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:47:57.473698 4537 catalog_manager.cc:1347] Generated new cluster ID: bf6a027b87e342fe9ac30288168432e2
I20260807 10:47:57.473839 4537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:47:57.486430 4537 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:47:57.488126 4537 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:47:57.495975 4537 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134: Generated new TSK 0
I20260807 10:47:57.496995 4537 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:47:57.599567 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45661
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:44611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:47:58.005581 4555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:58.005941 4555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:58.006062 4555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:58.014127 4555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:58.014284 4555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:58.014451 4555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:47:58.025342 4555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:44611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45661
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:58.026985 4555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:58.028523 4555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:58.043500 4561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:58.043581 4560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:58.043525 4564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:58.044286 4555 server_base.cc:1034] running on GCE node
I20260807 10:47:58.044992 4555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:58.046121 4555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:58.047345 4555 hybrid_clock.cc:648] HybridClock initialized: now 1786099678047279 us; error 48 us; skew 500 ppm
I20260807 10:47:58.047700 4555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:58 dist-test-slave-42z9 krb5kdc[4406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099678, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:58.051177 4555 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:47:58.052811 4555 webserver.cc:460] Webserver started at http://127.11.46.129:35581/ using document root <none> and password file <none>
I20260807 10:47:58.053619 4555 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:58.053738 4555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:58.054041 4555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:47:58.057277 4555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "59a71011d3b84b4787c7fad1a6298848"
format_stamp: "Formatted at 2026-08-07 10:47:58 on dist-test-slave-42z9"
server_key: "a0d9cee24d6720d1cf7b21e69f81d27a"
server_key_iv: "b14c2b6df39699c05871368352d6ae59"
server_key_version: "encryptionkey@0"
I20260807 10:47:58.058205 4555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "59a71011d3b84b4787c7fad1a6298848"
format_stamp: "Formatted at 2026-08-07 10:47:58 on dist-test-slave-42z9"
server_key: "a0d9cee24d6720d1cf7b21e69f81d27a"
server_key_iv: "b14c2b6df39699c05871368352d6ae59"
server_key_version: "encryptionkey@0"
I20260807 10:47:58.064332 4555 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:47:58.068416 4573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:58.070247 4555 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:47:58.070443 4555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "59a71011d3b84b4787c7fad1a6298848"
format_stamp: "Formatted at 2026-08-07 10:47:58 on dist-test-slave-42z9"
server_key: "a0d9cee24d6720d1cf7b21e69f81d27a"
server_key_iv: "b14c2b6df39699c05871368352d6ae59"
server_key_version: "encryptionkey@0"
I20260807 10:47:58.070665 4555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:58.089694 4555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:58.094345 4555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:58.094655 4555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:58.095785 4555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:47:58.097388 4555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:47:58.097501 4555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 10:47:58.097635 4555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:47:58.097699 4555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:58.133014 4555 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:41593
I20260807 10:47:58.133049 4734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:41593 every 8 connection(s)
I20260807 10:47:58.134562 4555 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:47:58.142186 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 4555
I20260807 10:47:58.142426 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:47:58.143291 11450 external_mini_cluster.cc:1428] Setting key 8af3e4c8674d0afbe5510bccb5abf850
Aug 07 10:47:58 dist-test-slave-42z9 krb5kdc[4406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099678, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:47:58.160077 4738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:58.137364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:58003 (local address 127.11.46.190:45661)
0807 10:47:58.137900 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:58.137905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:58.139009 (+ 1104us) server_negotiation.cc:407] Connection header received
0807 10:47:58.141108 (+ 2099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:58.141114 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:58.141213 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:58.141322 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:58.143911 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:58.144901 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:58.147415 (+ 2514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:58.147890 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:58.148036 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:58.152926 (+ 4890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:58.152932 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:58.152936 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:58.152982 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:58.156225 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:58.157233 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:58.157239 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:58.157243 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:58.157423 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:58.157935 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:58.157940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:58.157943 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:58.158327 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:58.158493 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:58.159375 (+ 882us) server_negotiation.cc:299] Negotiation successful
0807 10:47:58.159666 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":284,"threads_started":1}
I20260807 10:47:58.161240 4739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:58.137976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:45661 (local address 127.11.46.129:58003)
0807 10:47:58.138803 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:58.138859 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:58.140756 (+ 1897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:58.141704 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:58.141717 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:58.142621 (+ 904us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:47:58.143631 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:58.143668 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:58.145116 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:58.145120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:58.147180 (+ 2060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:58.147204 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:58.148198 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:58.148207 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:58.148553 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:58.149417 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:47:58.149497 (+ 80us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:47:58.152507 (+ 3010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:47:58.156444 (+ 3937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:58.156455 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:58.156474 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:58.157050 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:58.157562 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:58.157566 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:58.157568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:58.157809 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:58.158457 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:47:58.158464 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:47:58.158913 (+ 449us) client_negotiation.cc:769] Sending connection context
0807 10:47:58.159200 (+ 287us) client_negotiation.cc:240] Negotiation successful
0807 10:47:58.159744 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":309,"threads_started":1}
I20260807 10:47:58.163158 4735 heartbeater.cc:347] Connected to a master server at 127.11.46.190:45661
I20260807 10:47:58.163609 4735 heartbeater.cc:464] Registering TS with master...
I20260807 10:47:58.164757 4735 heartbeater.cc:511] Master 127.11.46.190:45661 requested a full tablet report, sending...
I20260807 10:47:58.167909 4469 ts_manager.cc:194] Registered new tserver with Master: 59a71011d3b84b4787c7fad1a6298848 (127.11.46.129:41593)
I20260807 10:47:58.170193 4469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:58003
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:47:58.229736 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45661
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:44611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:47:58.615903 4744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:58.616235 4744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:58.616385 4744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:58.624146 4744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:58.624307 4744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:58.624475 4744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:47:58.635198 4744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:44611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45661
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:58.636754 4744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:58.638276 4744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:58.653059 4752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:58.652942 4757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:58.653007 4753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:58.653420 4744 server_base.cc:1034] running on GCE node
I20260807 10:47:58.654862 4744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:58.656005 4744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:58.657226 4744 hybrid_clock.cc:648] HybridClock initialized: now 1786099678657158 us; error 58 us; skew 500 ppm
I20260807 10:47:58.657635 4744 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:58 dist-test-slave-42z9 krb5kdc[4406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099678, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:58.661198 4744 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:47:58.662961 4744 webserver.cc:460] Webserver started at http://127.11.46.130:42467/ using document root <none> and password file <none>
I20260807 10:47:58.663765 4744 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:58.663897 4744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:58.664234 4744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:47:58.667677 4744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "ee8d0ac77f9a48baa233b0212b8aedff"
format_stamp: "Formatted at 2026-08-07 10:47:58 on dist-test-slave-42z9"
server_key: "8c53c1c0ac4115d1d99134a3e440bd69"
server_key_iv: "3627fbf46524b1aa79aff6984a9c6eaf"
server_key_version: "encryptionkey@0"
I20260807 10:47:58.668560 4744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "ee8d0ac77f9a48baa233b0212b8aedff"
format_stamp: "Formatted at 2026-08-07 10:47:58 on dist-test-slave-42z9"
server_key: "8c53c1c0ac4115d1d99134a3e440bd69"
server_key_iv: "3627fbf46524b1aa79aff6984a9c6eaf"
server_key_version: "encryptionkey@0"
I20260807 10:47:58.675348 4744 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260807 10:47:58.679673 4765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:58.681281 4744 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:47:58.681572 4744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "ee8d0ac77f9a48baa233b0212b8aedff"
format_stamp: "Formatted at 2026-08-07 10:47:58 on dist-test-slave-42z9"
server_key: "8c53c1c0ac4115d1d99134a3e440bd69"
server_key_iv: "3627fbf46524b1aa79aff6984a9c6eaf"
server_key_version: "encryptionkey@0"
I20260807 10:47:58.681819 4744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:58.709244 4744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:58.713831 4744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:58.714154 4744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:58.715246 4744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:47:58.716868 4744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:47:58.716970 4744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:58.717108 4744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:47:58.717164 4744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:58.751565 4744 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:32975
I20260807 10:47:58.751610 4927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:32975 every 8 connection(s)
I20260807 10:47:58.753973 4744 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:47:58.759765 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 4744
I20260807 10:47:58.760085 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:47:58.760923 11450 external_mini_cluster.cc:1428] Setting key a679ebea866b3ffbf3bb1e89ce6a9743
Aug 07 10:47:58 dist-test-slave-42z9 krb5kdc[4406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099678, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:47:58.783861 4930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:58.759181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:48373 (local address 127.11.46.190:45661)
0807 10:47:58.760003 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:58.760012 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:58.762518 (+ 2506us) server_negotiation.cc:407] Connection header received
0807 10:47:58.765961 (+ 3443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:58.765968 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:58.766118 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:58.766269 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:58.768694 (+ 2425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:58.769761 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:58.771735 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:58.772355 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:58.772528 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:58.776736 (+ 4208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:58.776744 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:58.776748 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:58.776796 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:58.779933 (+ 3137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:58.780888 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:58.780894 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:58.780897 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:58.781089 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:58.781709 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:58.781713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:58.781716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:58.782112 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:58.782273 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:58.783203 (+ 930us) server_negotiation.cc:299] Negotiation successful
0807 10:47:58.783482 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":403,"threads_started":1}
I20260807 10:47:58.785050 4931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:58.760502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:45661 (local address 127.11.46.130:48373)
0807 10:47:58.762105 (+ 1603us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:58.762228 (+ 123us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:58.765264 (+ 3036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:58.766696 (+ 1432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:58.766712 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:58.767631 (+ 919us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:47:58.768401 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:58.768426 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:58.769966 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:58.769971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:58.771462 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:58.771489 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:58.772624 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:58.772630 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:58.772869 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:58.773735 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:47:58.773774 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:47:58.776402 (+ 2628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:47:58.780141 (+ 3739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:58.780152 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:58.780170 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:58.780713 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:58.781242 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:58.781246 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:58.781250 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:58.781580 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:58.782238 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:47:58.782248 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:47:58.782739 (+ 491us) client_negotiation.cc:769] Sending connection context
0807 10:47:58.783057 (+ 318us) client_negotiation.cc:240] Negotiation successful
0807 10:47:58.783652 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1058,"thread_start_us":583,"threads_started":1}
I20260807 10:47:58.787009 4928 heartbeater.cc:347] Connected to a master server at 127.11.46.190:45661
I20260807 10:47:58.787382 4928 heartbeater.cc:464] Registering TS with master...
I20260807 10:47:58.788269 4928 heartbeater.cc:511] Master 127.11.46.190:45661 requested a full tablet report, sending...
I20260807 10:47:58.790115 4469 ts_manager.cc:194] Registered new tserver with Master: ee8d0ac77f9a48baa233b0212b8aedff (127.11.46.130:32975)
I20260807 10:47:58.791025 4469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:48373
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:47:58.848153 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45661
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:44611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:47:59.174537 4735 heartbeater.cc:503] Master 127.11.46.190:45661 was elected leader, sending a full tablet report...
W20260807 10:47:59.237736 4936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:47:59.238078 4936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:47:59.238237 4936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:47:59.246081 4936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:47:59.246238 4936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:47:59.246395 4936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:47:59.257259 4936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:44611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:45661
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:47:59.258826 4936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:47:59.260492 4936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:47:59.275098 4944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:59.275146 4947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:47:59.275031 4945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:47:59.276124 4936 server_base.cc:1034] running on GCE node
I20260807 10:47:59.276889 4936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:47:59.278070 4936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:47:59.279311 4936 hybrid_clock.cc:648] HybridClock initialized: now 1786099679279249 us; error 53 us; skew 500 ppm
I20260807 10:47:59.279696 4936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:47:59 dist-test-slave-42z9 krb5kdc[4406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099679, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:47:59.283124 4936 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:47:59.284869 4936 webserver.cc:460] Webserver started at http://127.11.46.131:42049/ using document root <none> and password file <none>
I20260807 10:47:59.285795 4936 fs_manager.cc:359] Metadata directory not provided
I20260807 10:47:59.285944 4936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:47:59.286412 4936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:47:59.289928 4936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "4441159c00b0443db9488ea2098b222a"
format_stamp: "Formatted at 2026-08-07 10:47:59 on dist-test-slave-42z9"
server_key: "5113dcf420ab42fcb29d7a51fbc3a5b8"
server_key_iv: "65aa2501732e4b3842bf66b5fa2c660d"
server_key_version: "encryptionkey@0"
I20260807 10:47:59.290838 4936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "4441159c00b0443db9488ea2098b222a"
format_stamp: "Formatted at 2026-08-07 10:47:59 on dist-test-slave-42z9"
server_key: "5113dcf420ab42fcb29d7a51fbc3a5b8"
server_key_iv: "65aa2501732e4b3842bf66b5fa2c660d"
server_key_version: "encryptionkey@0"
I20260807 10:47:59.297112 4936 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260807 10:47:59.301281 4961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:59.302892 4936 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:47:59.303097 4936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "4441159c00b0443db9488ea2098b222a"
format_stamp: "Formatted at 2026-08-07 10:47:59 on dist-test-slave-42z9"
server_key: "5113dcf420ab42fcb29d7a51fbc3a5b8"
server_key_iv: "65aa2501732e4b3842bf66b5fa2c660d"
server_key_version: "encryptionkey@0"
I20260807 10:47:59.303321 4936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:47:59.323153 4936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:47:59.328361 4936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:47:59.328689 4936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:47:59.329936 4936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:47:59.331563 4936 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:47:59.331650 4936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:59.331763 4936 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:47:59.331822 4936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:47:59.365299 4936 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:45093
I20260807 10:47:59.365339 5131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:45093 every 8 connection(s)
I20260807 10:47:59.366869 4936 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:47:59.368767 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 4936
I20260807 10:47:59.368952 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:47:59.369510 11450 external_mini_cluster.cc:1428] Setting key 7b39f6de0a8168d698b7507bd1e98f92
Aug 07 10:47:59 dist-test-slave-42z9 krb5kdc[4406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099679, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:47:59.390689 5138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.370040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:59261 (local address 127.11.46.190:45661)
0807 10:47:59.370611 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:59.370618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:59.371921 (+ 1303us) server_negotiation.cc:407] Connection header received
0807 10:47:59.374329 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:59.374335 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:59.374431 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:59.374531 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:59.376451 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.377246 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.379038 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.379494 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.379619 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.383762 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:59.383770 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:59.383775 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:59.383825 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:59.387315 (+ 3490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:59.388212 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:59.388216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:59.388219 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:59.388359 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:59.388795 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:59.388799 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:59.388801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:59.389110 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:59.389241 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:59.390137 (+ 896us) server_negotiation.cc:299] Negotiation successful
0807 10:47:59.390363 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":257,"threads_started":1}
I20260807 10:47:59.391759 5139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.370845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:45661 (local address 127.11.46.131:59261)
0807 10:47:59.371740 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:59.371793 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:59.374016 (+ 2223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:59.374847 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:59.374861 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:59.375546 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:47:59.376245 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.376275 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.377484 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.377491 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.378858 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.378876 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.379773 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.379782 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.380050 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.380761 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:47:59.380795 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:47:59.383437 (+ 2642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:47:59.387510 (+ 4073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:59.387520 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:59.387539 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:59.388094 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:59.388465 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:47:59.388468 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:47:59.388471 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:47:59.388702 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:47:59.389212 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:47:59.389219 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:47:59.389696 (+ 477us) client_negotiation.cc:769] Sending connection context
0807 10:47:59.389982 (+ 286us) client_negotiation.cc:240] Negotiation successful
0807 10:47:59.390486 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":346,"threads_started":1}
I20260807 10:47:59.393431 5134 heartbeater.cc:347] Connected to a master server at 127.11.46.190:45661
I20260807 10:47:59.393857 5134 heartbeater.cc:464] Registering TS with master...
I20260807 10:47:59.394766 5134 heartbeater.cc:511] Master 127.11.46.190:45661 requested a full tablet report, sending...
I20260807 10:47:59.396714 4469 ts_manager.cc:194] Registered new tserver with Master: 4441159c00b0443db9488ea2098b222a (127.11.46.131:45093)
I20260807 10:47:59.397835 4469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:59261
I20260807 10:47:59.398953 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:47:59.418697 5138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.404511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37186 (local address 127.11.46.190:45661)
0807 10:47:59.404695 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:59.404702 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:59.405180 (+ 478us) server_negotiation.cc:407] Connection header received
0807 10:47:59.405369 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:59.405374 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:59.405519 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:59.405625 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:59.407445 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.408285 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.409814 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.410250 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.410380 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.412873 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:59.412880 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:59.412883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:59.412930 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:59.415670 (+ 2740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:59.416477 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:59.416482 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:59.416485 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:59.416638 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:59.417027 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:59.417033 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:59.417037 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:59.417422 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:59.417722 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:59.418122 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 10:47:59.418374 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:47:59.423388 4469 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37186:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:47:59.430896 4469 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:47:59.457669 5156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.445103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:41593 (local address 127.0.0.1:36964)
0807 10:47:59.446139 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:59.446188 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:59.446426 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:59.447653 (+ 1227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:59.447662 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:59.447698 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:47:59.448615 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.448632 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.450891 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.450898 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.453591 (+ 2693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.453619 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.456381 (+ 2762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.456390 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.456687 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.456750 (+ 63us) client_negotiation.cc:769] Sending connection context
0807 10:47:59.456914 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 10:47:59.457168 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":753,"thread_start_us":950,"threads_started":1}
I20260807 10:47:59.459000 5157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.445368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36964 (local address 127.11.46.129:41593)
0807 10:47:59.446124 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:59.446133 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:59.446661 (+ 528us) server_negotiation.cc:407] Connection header received
0807 10:47:59.446790 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:59.446798 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:59.447103 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:59.447296 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:47:59.448843 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.450689 (+ 1846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.453877 (+ 3188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.455702 (+ 1825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.455877 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.456199 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:59.458379 (+ 2180us) server_negotiation.cc:299] Negotiation successful
0807 10:47:59.458620 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":388,"threads_started":1}
I20260807 10:47:59.466420 4647 tablet_service.cc:1467] Processing CreateTablet for tablet 718fdbbb7c0e4ab49a41d13e41141a25 (DEFAULT_TABLE table=test-table [id=aa797897a1b94fca90337944ebb4d8aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:47:59.467763 5164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.447311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47334 (local address 127.11.46.131:45093)
0807 10:47:59.460297 (+ 12986us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:59.460306 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:59.460340 (+ 34us) server_negotiation.cc:407] Connection header received
0807 10:47:59.460442 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:59.460450 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:59.460702 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:59.460911 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:47:59.461399 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.462752 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.465619 (+ 2867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.466678 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.466814 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.467099 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:59.467260 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 10:47:59.467435 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12791,"thread_start_us":12633,"threads_started":1}
I20260807 10:47:59.467746 5156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.446898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:45093 (local address 127.0.0.1:47334)
0807 10:47:59.458000 (+ 11102us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:59.458021 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:59.458176 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:59.460931 (+ 2755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:59.460936 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:59.460970 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:47:59.461213 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.461227 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.462964 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.462970 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.465394 (+ 2424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.465413 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.466862 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.466869 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.467059 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.467097 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 10:47:59.467195 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 10:47:59.467359 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10991,"mutex_wait_us":26,"thread_start_us":13528,"threads_started":1}
I20260807 10:47:59.468331 4647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 718fdbbb7c0e4ab49a41d13e41141a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:47:59.469906 5160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.446352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35792 (local address 127.11.46.130:32975)
0807 10:47:59.459793 (+ 13441us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:59.459803 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:59.459841 (+ 38us) server_negotiation.cc:407] Connection header received
0807 10:47:59.459957 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:59.459967 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:59.460306 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:59.460561 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:47:59.461676 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.463147 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.465838 (+ 2691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.467372 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.467532 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.467742 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:59.469349 (+ 1607us) server_negotiation.cc:299] Negotiation successful
0807 10:47:59.469604 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13261,"thread_start_us":13140,"threads_started":1}
I20260807 10:47:59.470573 5159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.445892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:32975 (local address 127.0.0.1:35792)
0807 10:47:59.446562 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:59.446579 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:59.446695 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:59.460704 (+ 14009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:59.460763 (+ 59us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:59.460801 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:47:59.461415 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.461430 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.463296 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.463301 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.465635 (+ 2334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.465652 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.468531 (+ 2879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.468539 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.468739 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.468772 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:47:59.468864 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 10:47:59.470274 (+ 1410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":76,"thread_start_us":1722,"threads_started":1}
I20260807 10:47:59.472229 5037 tablet_service.cc:1467] Processing CreateTablet for tablet 718fdbbb7c0e4ab49a41d13e41141a25 (DEFAULT_TABLE table=test-table [id=aa797897a1b94fca90337944ebb4d8aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:47:59.474090 5037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 718fdbbb7c0e4ab49a41d13e41141a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:47:59.474227 4838 tablet_service.cc:1467] Processing CreateTablet for tablet 718fdbbb7c0e4ab49a41d13e41141a25 (DEFAULT_TABLE table=test-table [id=aa797897a1b94fca90337944ebb4d8aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:47:59.475714 4838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 718fdbbb7c0e4ab49a41d13e41141a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:47:59.486693 5165 tablet_bootstrap.cc:492] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: Bootstrap starting.
I20260807 10:47:59.489380 5166 tablet_bootstrap.cc:492] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: Bootstrap starting.
I20260807 10:47:59.491496 5168 tablet_bootstrap.cc:492] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: Bootstrap starting.
I20260807 10:47:59.492098 5165 tablet_bootstrap.cc:654] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: Neither blocks nor log segments found. Creating new log.
I20260807 10:47:59.493431 5166 tablet_bootstrap.cc:654] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: Neither blocks nor log segments found. Creating new log.
I20260807 10:47:59.493682 5165 log.cc:824] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: Log is configured to *not* fsync() on all Append() calls
I20260807 10:47:59.494750 5166 log.cc:824] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: Log is configured to *not* fsync() on all Append() calls
I20260807 10:47:59.496871 5168 tablet_bootstrap.cc:654] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: Neither blocks nor log segments found. Creating new log.
I20260807 10:47:59.497586 5165 tablet_bootstrap.cc:492] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: No bootstrap required, opened a new log
I20260807 10:47:59.497923 5165 ts_tablet_manager.cc:1397] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260807 10:47:59.498296 5168 log.cc:824] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:47:59.499814 5166 tablet_bootstrap.cc:492] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: No bootstrap required, opened a new log
I20260807 10:47:59.500087 5166 ts_tablet_manager.cc:1397] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260807 10:47:59.501852 5168 tablet_bootstrap.cc:492] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: No bootstrap required, opened a new log
I20260807 10:47:59.502177 5168 ts_tablet_manager.cc:1397] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260807 10:47:59.508658 5166 raft_consensus.cc:348] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 } } peers { permanent_uuid: "4441159c00b0443db9488ea2098b222a" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 45093 } } peers { permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 } }
I20260807 10:47:59.508761 5165 raft_consensus.cc:348] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 } } peers { permanent_uuid: "4441159c00b0443db9488ea2098b222a" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 45093 } } peers { permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 } }
I20260807 10:47:59.509162 5166 raft_consensus.cc:374] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:47:59.509246 5165 raft_consensus.cc:374] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:47:59.509260 5166 raft_consensus.cc:729] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8d0ac77f9a48baa233b0212b8aedff, State: Initialized, Role: FOLLOWER
I20260807 10:47:59.509361 5165 raft_consensus.cc:729] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59a71011d3b84b4787c7fad1a6298848, State: Initialized, Role: FOLLOWER
I20260807 10:47:59.509972 5166 consensus_queue.cc:260] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 } } peers { permanent_uuid: "4441159c00b0443db9488ea2098b222a" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 45093 } } peers { permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 } }
I20260807 10:47:59.510036 5165 consensus_queue.cc:260] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 } } peers { permanent_uuid: "4441159c00b0443db9488ea2098b222a" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 45093 } } peers { permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 } }
I20260807 10:47:59.514048 5168 raft_consensus.cc:348] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 } } peers { permanent_uuid: "4441159c00b0443db9488ea2098b222a" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 45093 } } peers { permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 } }
I20260807 10:47:59.514711 5168 raft_consensus.cc:374] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:47:59.514838 5168 raft_consensus.cc:729] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4441159c00b0443db9488ea2098b222a, State: Initialized, Role: FOLLOWER
I20260807 10:47:59.516016 4928 heartbeater.cc:503] Master 127.11.46.190:45661 was elected leader, sending a full tablet report...
I20260807 10:47:59.516356 5166 ts_tablet_manager.cc:1428] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20260807 10:47:59.517161 5165 ts_tablet_manager.cc:1428] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: Time spent starting tablet: real 0.019s user 0.010s sys 0.008s
I20260807 10:47:59.515722 5168 consensus_queue.cc:260] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 } } peers { permanent_uuid: "4441159c00b0443db9488ea2098b222a" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 45093 } } peers { permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 } }
I20260807 10:47:59.518597 5134 heartbeater.cc:503] Master 127.11.46.190:45661 was elected leader, sending a full tablet report...
I20260807 10:47:59.519363 5168 ts_tablet_manager.cc:1428] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: Time spent starting tablet: real 0.017s user 0.011s sys 0.003s
I20260807 10:47:59.607590 5175 raft_consensus.cc:482] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:47:59.607933 5175 raft_consensus.cc:504] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 } } peers { permanent_uuid: "4441159c00b0443db9488ea2098b222a" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 45093 } } peers { permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 } }
I20260807 10:47:59.609941 5175 leader_election.cc:288] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59a71011d3b84b4787c7fad1a6298848 (127.11.46.129:41593), ee8d0ac77f9a48baa233b0212b8aedff (127.11.46.130:32975)
I20260807 10:47:59.616716 5157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.610554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:57707 (local address 127.11.46.129:41593)
0807 10:47:59.610768 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:59.610774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:59.610798 (+ 24us) server_negotiation.cc:407] Connection header received
0807 10:47:59.610997 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:59.611002 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:59.611088 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:59.611206 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:47:59.611596 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.612616 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.614623 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.615738 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.615872 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.615932 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:59.616297 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 10:47:59.616456 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:47:59.616725 5139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.610253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:41593 (local address 127.11.46.131:57707)
0807 10:47:59.610634 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:59.610654 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:59.610808 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:59.611250 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:59.611254 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:59.611281 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:47:59.611461 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.611469 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.612769 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.612774 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.614441 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.614456 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.615912 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.615918 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.616129 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.616167 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 10:47:59.616278 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 10:47:59.616429 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200}
I20260807 10:47:59.617744 5160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.610570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:34521 (local address 127.11.46.130:32975)
0807 10:47:59.610768 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:59.610774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:59.611469 (+ 695us) server_negotiation.cc:407] Connection header received
0807 10:47:59.611686 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:59.611690 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:59.611757 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:59.611828 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:47:59.612461 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.613471 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.615455 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.616524 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.616707 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.616784 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:59.617324 (+ 540us) server_negotiation.cc:299] Negotiation successful
0807 10:47:59.617494 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:47:59.617784 5176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.610382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:32975 (local address 127.11.46.131:34521)
0807 10:47:59.611354 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0807 10:47:59.611373 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:47:59.611517 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:47:59.611880 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:47:59.611884 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:47:59.611913 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:47:59.612283 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.612296 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.613631 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.613635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.615268 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:47:59.615284 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.616941 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.616948 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:47:59.617127 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.617160 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:47:59.617258 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 10:47:59.617400 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":829,"thread_start_us":555,"threads_started":1}
I20260807 10:47:59.618060 4671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "718fdbbb7c0e4ab49a41d13e41141a25" candidate_uuid: "4441159c00b0443db9488ea2098b222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59a71011d3b84b4787c7fad1a6298848" is_pre_election: true
W20260807 10:47:59.618748 5137 tablet.cc:2369] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:47:59.618746 4671 raft_consensus.cc:2454] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4441159c00b0443db9488ea2098b222a in term 0.
I20260807 10:47:59.618796 4866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "718fdbbb7c0e4ab49a41d13e41141a25" candidate_uuid: "4441159c00b0443db9488ea2098b222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" is_pre_election: true
I20260807 10:47:59.619374 4866 raft_consensus.cc:2454] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4441159c00b0443db9488ea2098b222a in term 0.
I20260807 10:47:59.619587 4967 leader_election.cc:302] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4441159c00b0443db9488ea2098b222a, 59a71011d3b84b4787c7fad1a6298848; no voters:
I20260807 10:47:59.620044 5175 raft_consensus.cc:2781] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:47:59.620198 5175 raft_consensus.cc:482] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:47:59.620297 5175 raft_consensus.cc:3037] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:47:59.622725 5175 raft_consensus.cc:504] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 } } peers { permanent_uuid: "4441159c00b0443db9488ea2098b222a" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 45093 } } peers { permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 } }
I20260807 10:47:59.623427 5175 leader_election.cc:288] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [CANDIDATE]: Term 1 election: Requested vote from peers 59a71011d3b84b4787c7fad1a6298848 (127.11.46.129:41593), ee8d0ac77f9a48baa233b0212b8aedff (127.11.46.130:32975)
I20260807 10:47:59.624014 4866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "718fdbbb7c0e4ab49a41d13e41141a25" candidate_uuid: "4441159c00b0443db9488ea2098b222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8d0ac77f9a48baa233b0212b8aedff"
I20260807 10:47:59.624047 4671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "718fdbbb7c0e4ab49a41d13e41141a25" candidate_uuid: "4441159c00b0443db9488ea2098b222a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59a71011d3b84b4787c7fad1a6298848"
I20260807 10:47:59.624231 4866 raft_consensus.cc:3037] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:47:59.624279 4671 raft_consensus.cc:3037] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:47:59.626768 4671 raft_consensus.cc:2454] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4441159c00b0443db9488ea2098b222a in term 1.
I20260807 10:47:59.626770 4866 raft_consensus.cc:2454] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4441159c00b0443db9488ea2098b222a in term 1.
I20260807 10:47:59.627363 4966 leader_election.cc:302] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4441159c00b0443db9488ea2098b222a, ee8d0ac77f9a48baa233b0212b8aedff; no voters:
I20260807 10:47:59.627736 5175 raft_consensus.cc:2781] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:47:59.628235 5175 raft_consensus.cc:686] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 1 LEADER]: Becoming Leader. State: Replica: 4441159c00b0443db9488ea2098b222a, State: Running, Role: LEADER
I20260807 10:47:59.628741 5175 consensus_queue.cc:237] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 } } peers { permanent_uuid: "4441159c00b0443db9488ea2098b222a" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 45093 } } peers { permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 } }
I20260807 10:47:59.634052 4469 catalog_manager.cc:5495] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a reported cstate change: term changed from 0 to 1, leader changed from <none> to 4441159c00b0443db9488ea2098b222a (127.11.46.131). New cstate: current_term: 1 leader_uuid: "4441159c00b0443db9488ea2098b222a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4441159c00b0443db9488ea2098b222a" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 45093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 } health_report { overall_health: UNKNOWN } } }
W20260807 10:47:59.637511 4736 tablet.cc:2369] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:47:59.668836 5164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.663321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35568 (local address 127.11.46.131:45093)
0807 10:47:59.663555 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:59.663561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:59.663581 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:47:59.663681 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:59.663685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:59.663770 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:59.663916 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:47:59.664326 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.665081 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.666604 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.667021 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.667138 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.667664 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:47:59.668208 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:47:59.668362 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:59.668465 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 10:47:59.668560 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 10:47:59.677702 4671 raft_consensus.cc:1261] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848 [term 1 FOLLOWER]: Refusing update from remote peer 4441159c00b0443db9488ea2098b222a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:47:59.677706 4866 raft_consensus.cc:1261] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff [term 1 FOLLOWER]: Refusing update from remote peer 4441159c00b0443db9488ea2098b222a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:47:59.678752 5177 consensus_queue.cc:1035] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [LEADER]: Connected to new peer: Peer: permanent_uuid: "59a71011d3b84b4787c7fad1a6298848" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 41593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:47:59.679114 5175 consensus_queue.cc:1035] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8d0ac77f9a48baa233b0212b8aedff" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:47:59.690256 5181 mvcc.cc:205] Tried to move back new op lower bound from 7315864287948988416 to 7315864287764021248. Current Snapshot: MvccSnapshot[applied={T|T < 7315864287948988416}]
I20260807 10:47:59.692442 5184 mvcc.cc:205] Tried to move back new op lower bound from 7315864287948988416 to 7315864287764021248. Current Snapshot: MvccSnapshot[applied={T|T < 7315864287948988416}]
I20260807 10:47:59.707614 4464 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37186:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:47:59.708024 4464 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37186:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:47:59.712626 4464 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83467c54441e4cd8a005ce604fcfa134: Sending DeleteTablet for 3 replicas of tablet 718fdbbb7c0e4ab49a41d13e41141a25
I20260807 10:47:59.714149 4838 tablet_service.cc:1514] Processing DeleteTablet for tablet 718fdbbb7c0e4ab49a41d13e41141a25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:47:59 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:35792
I20260807 10:47:59.714166 4647 tablet_service.cc:1514] Processing DeleteTablet for tablet 718fdbbb7c0e4ab49a41d13e41141a25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:47:59 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:36964
I20260807 10:47:59.714253 5037 tablet_service.cc:1514] Processing DeleteTablet for tablet 718fdbbb7c0e4ab49a41d13e41141a25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:47:59 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:47334
I20260807 10:47:59.716918 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 4555
I20260807 10:47:59.725914 5197 tablet_replica.cc:330] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: stopping tablet replica
I20260807 10:47:59.726542 5197 raft_consensus.cc:2229] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:47:59.727218 5197 raft_consensus.cc:2258] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:47:59.728339 5193 tablet_replica.cc:330] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: stopping tablet replica
I20260807 10:47:59.728940 5193 raft_consensus.cc:2229] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:47:59.729996 5195 tablet_replica.cc:330] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: stopping tablet replica
I20260807 10:47:59.730407 5195 raft_consensus.cc:2229] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:47:59.731062 5195 raft_consensus.cc:2258] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:47:59.731635 5193 raft_consensus.cc:2258] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:47:59.733986 5193 ts_tablet_manager.cc:1905] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:47:59.733991 5195 ts_tablet_manager.cc:1905] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:47:59.737237 5197 ts_tablet_manager.cc:1905] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:47:59.742036 5195 ts_tablet_manager.cc:1918] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:47:59.742030 5193 ts_tablet_manager.cc:1918] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:47:59.742259 5193 log.cc:1196] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/718fdbbb7c0e4ab49a41d13e41141a25
I20260807 10:47:59.742444 5195 log.cc:1196] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/718fdbbb7c0e4ab49a41d13e41141a25
I20260807 10:47:59.742872 5193 ts_tablet_manager.cc:1939] T 718fdbbb7c0e4ab49a41d13e41141a25 P ee8d0ac77f9a48baa233b0212b8aedff: Deleting consensus metadata
I20260807 10:47:59.743273 5195 ts_tablet_manager.cc:1939] T 718fdbbb7c0e4ab49a41d13e41141a25 P 4441159c00b0443db9488ea2098b222a: Deleting consensus metadata
Aug 07 10:47:59 dist-test-slave-42z9 krb5kdc[4406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:47:59.745350 4452 catalog_manager.cc:4841] TS 4441159c00b0443db9488ea2098b222a (127.11.46.131:45093): tablet 718fdbbb7c0e4ab49a41d13e41141a25 (table test-table [id=aa797897a1b94fca90337944ebb4d8aa]) successfully deleted
I20260807 10:47:59.745289 4451 catalog_manager.cc:4841] TS ee8d0ac77f9a48baa233b0212b8aedff (127.11.46.130:32975): tablet 718fdbbb7c0e4ab49a41d13e41141a25 (table test-table [id=aa797897a1b94fca90337944ebb4d8aa]) successfully deleted
I20260807 10:47:59.751403 5197 ts_tablet_manager.cc:1918] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:47:59.751660 5197 log.cc:1196] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/718fdbbb7c0e4ab49a41d13e41141a25
I20260807 10:47:59.752310 5197 ts_tablet_manager.cc:1939] T 718fdbbb7c0e4ab49a41d13e41141a25 P 59a71011d3b84b4787c7fad1a6298848: Deleting consensus metadata
I20260807 10:47:59.754699 4452 catalog_manager.cc:4841] TS 59a71011d3b84b4787c7fad1a6298848 (127.11.46.129:41593): tablet 718fdbbb7c0e4ab49a41d13e41141a25 (table test-table [id=aa797897a1b94fca90337944ebb4d8aa]) successfully deleted
I20260807 10:47:59.755406 5157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.718392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33676 (local address 127.11.46.129:41593)
0807 10:47:59.718612 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:59.718620 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:59.728625 (+ 10005us) server_negotiation.cc:407] Connection header received
0807 10:47:59.728966 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:59.728973 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:59.729071 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:59.729158 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:59.731311 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.732512 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.737617 (+ 5105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.738329 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.738449 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.747028 (+ 8579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:59.747044 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:59.747062 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:59.747120 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:59.750495 (+ 3375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:59.751927 (+ 1432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:59.751941 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:59.751945 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:59.752219 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:59.752879 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:59.752885 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:59.752888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:59.753503 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:59.753878 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:59.754692 (+ 814us) server_negotiation.cc:299] Negotiation successful
0807 10:47:59.754985 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:47:59.756889 4729 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:47:59.890687 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 4555
I20260807 10:47:59.927870 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 4744
Aug 07 10:47:59 dist-test-slave-42z9 krb5kdc[4406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:47:59.949503 5160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:47:59.928840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55576 (local address 127.11.46.130:32975)
0807 10:47:59.929016 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 10:47:59.929021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:47:59.929042 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:47:59.929161 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:47:59.929166 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:47:59.929236 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:47:59.929311 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:47:59.931045 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.931843 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.933851 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:47:59.934288 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:47:59.934394 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:47:59.943218 (+ 8824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:47:59.943240 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:47:59.943259 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:47:59.943312 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:47:59.946350 (+ 3038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:59.947347 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:59.947355 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:59.947357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:59.947496 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:47:59.947904 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:47:59.947907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:47:59.947909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:47:59.948335 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:47:59.948586 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 10:47:59.948960 (+ 374us) server_negotiation.cc:299] Negotiation successful
0807 10:47:59.949157 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:47:59.950341 4922 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:00.045083 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 4744
I20260807 10:48:00.081617 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 4936
Aug 07 10:48:00 dist-test-slave-42z9 krb5kdc[4406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:48:00.107170 5164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:00.082651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35582 (local address 127.11.46.131:45093)
0807 10:48:00.082875 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:00.082881 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:00.083039 (+ 158us) server_negotiation.cc:407] Connection header received
0807 10:48:00.083254 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:00.083261 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:00.083378 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:00.083522 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:00.085712 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:00.086935 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:00.089135 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:00.089951 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:00.090138 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:00.096911 (+ 6773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:00.096944 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:00.096970 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:00.097042 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:00.102151 (+ 5109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:00.103359 (+ 1208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:00.103374 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:00.103378 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:00.103691 (+ 313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:00.104267 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:00.104273 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:00.104277 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:00.104908 (+ 631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:00.105293 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:00.105991 (+ 698us) server_negotiation.cc:299] Negotiation successful
0807 10:48:00.106298 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 10:48:00.108114 5122 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:00.247553 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 4936
I20260807 10:48:00.278194 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 4425
I20260807 10:48:00.279476 4510 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:00.396751 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 4425
2026-08-07T10:48:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5178 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T10:48:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:00Z Disabled control of system clock
I20260807 10:48:00.526368 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:39637
--webserver_interface=127.11.46.190
--webserver_port=0
--builtin_ntp_servers=127.11.46.148:39071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:39637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:48:00.929333 5210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:00.929747 5210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:00.929888 5210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:00.937683 5210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:00.937819 5210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:00.937885 5210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:00.937971 5210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:00.938030 5210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:00.948720 5210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:39637
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:39637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:00.950352 5210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:00.952536 5210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:00.965955 5219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:00.966001 5217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:00.966177 5216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:00.966682 5210 server_base.cc:1034] running on GCE node
I20260807 10:48:00.967520 5210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:00.969120 5210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:00.970368 5210 hybrid_clock.cc:648] HybridClock initialized: now 1786099680970298 us; error 46 us; skew 500 ppm
I20260807 10:48:00.970779 5210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:00.973254 5210 webserver.cc:460] Webserver started at http://127.11.46.190:42547/ using document root <none> and password file <none>
I20260807 10:48:00.974056 5210 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:00.974184 5210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:00.974527 5210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:00.977865 5210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "3edf4f93ca904aebab2fbdd768752295"
format_stamp: "Formatted at 2026-08-07 10:48:00 on dist-test-slave-42z9"
server_key: "bd1c2dcb821085ab285c1cae6d8106e7"
server_key_iv: "a7d0c9158b14c7cf32de5dc299bee990"
server_key_version: "encryptionkey@0"
I20260807 10:48:00.978829 5210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "3edf4f93ca904aebab2fbdd768752295"
format_stamp: "Formatted at 2026-08-07 10:48:00 on dist-test-slave-42z9"
server_key: "bd1c2dcb821085ab285c1cae6d8106e7"
server_key_iv: "a7d0c9158b14c7cf32de5dc299bee990"
server_key_version: "encryptionkey@0"
I20260807 10:48:00.984588 5210 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 10:48:00.988767 5230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:00.990468 5210 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:48:00.990681 5210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "3edf4f93ca904aebab2fbdd768752295"
format_stamp: "Formatted at 2026-08-07 10:48:00 on dist-test-slave-42z9"
server_key: "bd1c2dcb821085ab285c1cae6d8106e7"
server_key_iv: "a7d0c9158b14c7cf32de5dc299bee990"
server_key_version: "encryptionkey@0"
I20260807 10:48:00.990926 5210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:01.026005 5210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:01.027043 5210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:01.027369 5210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:01.048091 5210 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:39637
I20260807 10:48:01.048113 5306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:39637 every 8 connection(s)
I20260807 10:48:01.049722 5210 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:01.054345 5309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:01.056672 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 5210
I20260807 10:48:01.056874 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:01.057587 11450 external_mini_cluster.cc:1428] Setting key 973607e1a83aaf810276368447ab2ccd
I20260807 10:48:01.068563 5309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295: Bootstrap starting.
I20260807 10:48:01.072854 5309 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:01.073426 5313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:01.060025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36616 (local address 127.11.46.190:39637)
0807 10:48:01.061386 (+ 1361us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:01.061402 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:01.061504 (+ 102us) server_negotiation.cc:407] Connection header received
0807 10:48:01.063448 (+ 1944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:01.063478 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:01.064041 (+ 563us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:01.064460 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:01.065167 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:01.066684 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:01.068211 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:01.069044 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:01.069253 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:01.070685 (+ 1432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:01.070694 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:01.070711 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:01.071344 (+ 633us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:01.071508 (+ 164us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:01.071535 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:01.071657 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:01.071916 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 10:48:01.072280 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":787,"thread_start_us":464,"threads_started":1}
I20260807 10:48:01.074339 5309 log.cc:824] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:01.078105 5309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295: No bootstrap required, opened a new log
I20260807 10:48:01.086524 5309 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edf4f93ca904aebab2fbdd768752295" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 39637 } }
I20260807 10:48:01.087031 5309 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:01.087162 5309 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3edf4f93ca904aebab2fbdd768752295, State: Initialized, Role: FOLLOWER
I20260807 10:48:01.087846 5309 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edf4f93ca904aebab2fbdd768752295" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 39637 } }
I20260807 10:48:01.088133 5309 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:01.088289 5309 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:01.088485 5309 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:01.091073 5309 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edf4f93ca904aebab2fbdd768752295" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 39637 } }
I20260807 10:48:01.091722 5309 leader_election.cc:302] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3edf4f93ca904aebab2fbdd768752295; no voters:
I20260807 10:48:01.092381 5309 leader_election.cc:288] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:01.092527 5315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:01.093823 5315 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [term 1 LEADER]: Becoming Leader. State: Replica: 3edf4f93ca904aebab2fbdd768752295, State: Running, Role: LEADER
I20260807 10:48:01.094836 5309 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:01.094771 5315 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edf4f93ca904aebab2fbdd768752295" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 39637 } }
I20260807 10:48:01.098505 5316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3edf4f93ca904aebab2fbdd768752295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edf4f93ca904aebab2fbdd768752295" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 39637 } } }
I20260807 10:48:01.098483 5317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3edf4f93ca904aebab2fbdd768752295. Latest consensus state: current_term: 1 leader_uuid: "3edf4f93ca904aebab2fbdd768752295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3edf4f93ca904aebab2fbdd768752295" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 39637 } } }
I20260807 10:48:01.099090 5317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:01.099107 5316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:01.102705 5326 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:01.108479 5326 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:01.120335 5326 catalog_manager.cc:1347] Generated new cluster ID: 40c7d6a300a04297889ec5ed6c373815
I20260807 10:48:01.120486 5326 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:01.152863 5326 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:01.155184 5326 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:01.167821 5326 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295: Generated new TSK 0
I20260807 10:48:01.169104 5326 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:01.177979 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:39637
--builtin_ntp_servers=127.11.46.148:39071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:48:01.581758 5344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:01.582098 5344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:01.582203 5344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:01.589951 5344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:01.590090 5344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:01.590214 5344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:48:01.600642 5344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:39637
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:01.602212 5344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:01.604399 5344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:01.619087 5351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:01.619174 5350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:01.619874 5353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:01.620949 5344 server_base.cc:1034] running on GCE node
I20260807 10:48:01.621768 5344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:01.622948 5344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:01.624202 5344 hybrid_clock.cc:648] HybridClock initialized: now 1786099681624145 us; error 47 us; skew 500 ppm
I20260807 10:48:01.624595 5344 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:01.627352 5344 webserver.cc:460] Webserver started at http://127.11.46.129:43327/ using document root <none> and password file <none>
I20260807 10:48:01.628234 5344 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:01.628366 5344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:01.628741 5344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:01.632362 5344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "b3792a7934d548fd8ba73a0502a15e01"
format_stamp: "Formatted at 2026-08-07 10:48:01 on dist-test-slave-42z9"
server_key: "8cd425f4834c817de01c5a3bebb8afa8"
server_key_iv: "29199b67aca7e007b993227711f3bbc6"
server_key_version: "encryptionkey@0"
I20260807 10:48:01.633400 5344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "b3792a7934d548fd8ba73a0502a15e01"
format_stamp: "Formatted at 2026-08-07 10:48:01 on dist-test-slave-42z9"
server_key: "8cd425f4834c817de01c5a3bebb8afa8"
server_key_iv: "29199b67aca7e007b993227711f3bbc6"
server_key_version: "encryptionkey@0"
I20260807 10:48:01.639863 5344 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:48:01.644280 5360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:01.646034 5344 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 10:48:01.646253 5344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "b3792a7934d548fd8ba73a0502a15e01"
format_stamp: "Formatted at 2026-08-07 10:48:01 on dist-test-slave-42z9"
server_key: "8cd425f4834c817de01c5a3bebb8afa8"
server_key_iv: "29199b67aca7e007b993227711f3bbc6"
server_key_version: "encryptionkey@0"
I20260807 10:48:01.646543 5344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:01.661170 5344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:01.662218 5344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:01.662563 5344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:01.663718 5344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:01.665544 5344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:01.665661 5344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:01.665789 5344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:01.665868 5344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:01.702941 5344 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:45317
I20260807 10:48:01.702996 5519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:45317 every 8 connection(s)
I20260807 10:48:01.704460 5344 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:48:01.711246 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 5344
I20260807 10:48:01.711452 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:48:01.712013 11450 external_mini_cluster.cc:1428] Setting key a6fe0fdea966ab57ca367011c1928582
I20260807 10:48:01.715942 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:39637
--builtin_ntp_servers=127.11.46.148:39071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:48:01.720865 5523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:01.707859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:35499 (local address 127.11.46.190:39637)
0807 10:48:01.708393 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:01.708400 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:01.709901 (+ 1501us) server_negotiation.cc:407] Connection header received
0807 10:48:01.712291 (+ 2390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:01.712296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:01.712397 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:01.712511 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:01.714087 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:01.715067 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:01.717608 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:01.718046 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:01.718160 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:01.720042 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:01.720048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:01.720051 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:01.720077 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:01.720123 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:01.720136 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:01.720206 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:01.720475 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 10:48:01.720578 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":248,"threads_started":1}
I20260807 10:48:01.722522 5525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:01.708538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:39637 (local address 127.11.46.129:35499)
0807 10:48:01.709703 (+ 1165us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:01.709758 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:01.711895 (+ 2137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:01.712825 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:01.712835 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:01.712973 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:01.713849 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:01.713871 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:01.715260 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:01.715266 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:01.717345 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:01.717367 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:01.718347 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:01.718354 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:01.718708 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:01.719574 (+ 866us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:48:01.719578 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:01.719645 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:48:01.719769 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:01.720231 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:01.720244 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:01.720253 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 10:48:01.720460 (+ 207us) client_negotiation.cc:240] Negotiation successful
0807 10:48:01.720951 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":341,"threads_started":1}
I20260807 10:48:01.724412 5520 heartbeater.cc:347] Connected to a master server at 127.11.46.190:39637
I20260807 10:48:01.724817 5520 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:01.725937 5520 heartbeater.cc:511] Master 127.11.46.190:39637 requested a full tablet report, sending...
I20260807 10:48:01.728547 5254 ts_manager.cc:194] Registered new tserver with Master: b3792a7934d548fd8ba73a0502a15e01 (127.11.46.129:45317)
I20260807 10:48:01.730214 5254 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.129:35499
W20260807 10:48:02.113345 5527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:02.113725 5527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:02.113863 5527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:02.121814 5527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:02.121950 5527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:02.122112 5527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:48:02.132220 5527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:39637
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:02.133787 5527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:02.136061 5527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:02.151005 5538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:02.151084 5533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:02.151042 5535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:02.151844 5527 server_base.cc:1034] running on GCE node
I20260807 10:48:02.152702 5527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:02.153874 5527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:02.155105 5527 hybrid_clock.cc:648] HybridClock initialized: now 1786099682155058 us; error 52 us; skew 500 ppm
I20260807 10:48:02.155498 5527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:02.158216 5527 webserver.cc:460] Webserver started at http://127.11.46.130:40607/ using document root <none> and password file <none>
I20260807 10:48:02.159235 5527 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:02.159386 5527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:02.159729 5527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:02.163645 5527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "cc84ebbd6bbc403d929af18507a044bc"
format_stamp: "Formatted at 2026-08-07 10:48:02 on dist-test-slave-42z9"
server_key: "2d861faa56623b61a8d0675b0bb0e11b"
server_key_iv: "2041dfbe3329afb2e75c6fdf2664d21c"
server_key_version: "encryptionkey@0"
I20260807 10:48:02.164616 5527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "cc84ebbd6bbc403d929af18507a044bc"
format_stamp: "Formatted at 2026-08-07 10:48:02 on dist-test-slave-42z9"
server_key: "2d861faa56623b61a8d0675b0bb0e11b"
server_key_iv: "2041dfbe3329afb2e75c6fdf2664d21c"
server_key_version: "encryptionkey@0"
I20260807 10:48:02.171200 5527 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:48:02.175316 5548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:02.176860 5527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:48:02.177035 5527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "cc84ebbd6bbc403d929af18507a044bc"
format_stamp: "Formatted at 2026-08-07 10:48:02 on dist-test-slave-42z9"
server_key: "2d861faa56623b61a8d0675b0bb0e11b"
server_key_iv: "2041dfbe3329afb2e75c6fdf2664d21c"
server_key_version: "encryptionkey@0"
I20260807 10:48:02.177277 5527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:02.195780 5527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:02.196815 5527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:02.197136 5527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:02.198316 5527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:02.199985 5527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:02.200104 5527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:02.200213 5527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:02.200299 5527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:02.235321 5527 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:39525
I20260807 10:48:02.235384 5717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:39525 every 8 connection(s)
I20260807 10:48:02.236860 5527 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:48:02.237322 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 5527
I20260807 10:48:02.237535 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:48:02.238220 11450 external_mini_cluster.cc:1428] Setting key 07ac35807c48114b82fa4d71219acb31
I20260807 10:48:02.241500 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:39637
--builtin_ntp_servers=127.11.46.148:39071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:48:02.251627 5720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.239830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:44209 (local address 127.11.46.190:39637)
0807 10:48:02.240325 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:02.240330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:02.242124 (+ 1794us) server_negotiation.cc:407] Connection header received
0807 10:48:02.244064 (+ 1940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:02.244070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:02.244172 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:02.244295 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:02.245569 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.246578 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.248366 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.248941 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.249084 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.250657 (+ 1573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:02.250664 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:02.250669 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:02.250697 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:02.250752 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:02.250769 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:02.250861 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:02.251137 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 10:48:02.251256 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":245,"threads_started":1}
I20260807 10:48:02.252801 5722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.240670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:39637 (local address 127.11.46.130:44209)
0807 10:48:02.241916 (+ 1246us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:02.241984 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:02.243742 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:02.244532 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:02.244542 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:02.244649 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:02.245338 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:02.245361 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.246753 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.246757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:02.248173 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:02.248190 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.249190 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.249195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:02.249477 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.250275 (+ 798us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:48:02.250278 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:02.250329 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:48:02.250430 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:02.250876 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:02.250887 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:02.250895 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 10:48:02.251091 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 10:48:02.251500 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":367,"threads_started":1}
I20260807 10:48:02.254472 5718 heartbeater.cc:347] Connected to a master server at 127.11.46.190:39637
I20260807 10:48:02.254892 5718 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:02.256021 5718 heartbeater.cc:511] Master 127.11.46.190:39637 requested a full tablet report, sending...
I20260807 10:48:02.258044 5254 ts_manager.cc:194] Registered new tserver with Master: cc84ebbd6bbc403d929af18507a044bc (127.11.46.130:39525)
I20260807 10:48:02.259057 5254 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.130:44209
W20260807 10:48:02.636606 5723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:02.636965 5723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:02.637058 5723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:02.645006 5723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:02.645145 5723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:02.645263 5723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:48:02.655776 5723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:39071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:39637
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:02.657356 5723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:02.659722 5723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:02.674988 5734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:02.675063 5735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:02.675024 5737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:02.675947 5723 server_base.cc:1034] running on GCE node
I20260807 10:48:02.676678 5723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:02.677868 5723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:02.679131 5723 hybrid_clock.cc:648] HybridClock initialized: now 1786099682679070 us; error 50 us; skew 500 ppm
I20260807 10:48:02.679560 5723 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:02.682632 5723 webserver.cc:460] Webserver started at http://127.11.46.131:34337/ using document root <none> and password file <none>
I20260807 10:48:02.683506 5723 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:02.683624 5723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:02.683941 5723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:02.687515 5723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "45a06c4c01ed4c559fb2871299aee5c8"
format_stamp: "Formatted at 2026-08-07 10:48:02 on dist-test-slave-42z9"
server_key: "fbf3bd71f99cb07747eb25304978d6b8"
server_key_iv: "7c12565d5e4245e0335a9bf86f1760da"
server_key_version: "encryptionkey@0"
I20260807 10:48:02.688436 5723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "45a06c4c01ed4c559fb2871299aee5c8"
format_stamp: "Formatted at 2026-08-07 10:48:02 on dist-test-slave-42z9"
server_key: "fbf3bd71f99cb07747eb25304978d6b8"
server_key_iv: "7c12565d5e4245e0335a9bf86f1760da"
server_key_version: "encryptionkey@0"
I20260807 10:48:02.694890 5723 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 10:48:02.699599 5744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:02.701339 5723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:48:02.701601 5723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "45a06c4c01ed4c559fb2871299aee5c8"
format_stamp: "Formatted at 2026-08-07 10:48:02 on dist-test-slave-42z9"
server_key: "fbf3bd71f99cb07747eb25304978d6b8"
server_key_iv: "7c12565d5e4245e0335a9bf86f1760da"
server_key_version: "encryptionkey@0"
I20260807 10:48:02.701861 5723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:02.715967 5723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:02.717012 5723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:02.717386 5723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:02.718606 5723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:02.720404 5723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:02.720532 5723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:02.720691 5723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:02.720769 5723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:02.734448 5520 heartbeater.cc:503] Master 127.11.46.190:39637 was elected leader, sending a full tablet report...
I20260807 10:48:02.756196 5723 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:39517
I20260807 10:48:02.756232 5908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:39517 every 8 connection(s)
I20260807 10:48:02.757849 5723 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:48:02.762974 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 5723
I20260807 10:48:02.763238 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:48:02.763913 11450 external_mini_cluster.cc:1428] Setting key d1d9975bd3b69a5d6dc10f1a6352fc92
I20260807 10:48:02.773190 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.761219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:54749 (local address 127.11.46.190:39637)
0807 10:48:02.761951 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:02.761960 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:02.763513 (+ 1553us) server_negotiation.cc:407] Connection header received
0807 10:48:02.766085 (+ 2572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:02.766091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:02.766193 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:02.766297 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:02.767727 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.768524 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.770345 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.770799 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.770910 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.772421 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:02.772427 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:02.772430 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:02.772456 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:02.772499 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:02.772511 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:02.772593 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:02.772780 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 10:48:02.772881 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":396,"threads_started":1}
I20260807 10:48:02.774428 5917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.761591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:39637 (local address 127.11.46.131:54749)
0807 10:48:02.763263 (+ 1672us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:02.763327 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:02.765687 (+ 2360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:02.766578 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:02.766589 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:02.766708 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:02.767525 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:02.767560 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.768671 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.768676 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:02.770178 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:02.770197 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.771037 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.771042 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:02.771284 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.772065 (+ 781us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:48:02.772067 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:02.772123 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:48:02.772225 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:02.772591 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:02.772598 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:02.772605 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 10:48:02.772771 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 10:48:02.773146 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":840,"thread_start_us":391,"threads_started":1}
I20260807 10:48:02.776190 5910 heartbeater.cc:347] Connected to a master server at 127.11.46.190:39637
I20260807 10:48:02.776538 5910 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:02.777415 5910 heartbeater.cc:511] Master 127.11.46.190:39637 requested a full tablet report, sending...
I20260807 10:48:02.779157 5254 ts_manager.cc:194] Registered new tserver with Master: 45a06c4c01ed4c559fb2871299aee5c8 (127.11.46.131:39517)
I20260807 10:48:02.780354 5254 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.131:54749
I20260807 10:48:02.780426 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:48:02.793046 5914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.786072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36622 (local address 127.11.46.190:39637)
0807 10:48:02.786308 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:02.786315 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:02.786725 (+ 410us) server_negotiation.cc:407] Connection header received
0807 10:48:02.786924 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:02.786929 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:02.787007 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:02.787099 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:02.787726 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.788480 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.790243 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.790724 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.790859 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.792266 (+ 1407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:02.792272 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:02.792275 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:02.792301 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:02.792340 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:02.792353 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:02.792440 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:02.792599 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 10:48:02.792718 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:48:02.798070 5254 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:48:02.805732 5254 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:48:02.832650 5933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.822910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51046 (local address 127.11.46.130:39525)
0807 10:48:02.824553 (+ 1643us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:02.824562 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:02.824595 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:48:02.824694 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:02.824699 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:02.824928 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:02.825150 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:02.825959 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.827234 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.829986 (+ 2752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.831266 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.831424 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.831748 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:02.832071 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 10:48:02.832270 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1456,"thread_start_us":742,"threads_started":1}
I20260807 10:48:02.833204 5931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.821012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57240 (local address 127.11.46.131:39517)
0807 10:48:02.822045 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:02.822054 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:02.822415 (+ 361us) server_negotiation.cc:407] Connection header received
0807 10:48:02.822548 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:02.822557 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:02.822820 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:02.823056 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:02.824999 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.826627 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.829937 (+ 3310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.831548 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.831715 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.832018 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:02.832629 (+ 611us) server_negotiation.cc:299] Negotiation successful
0807 10:48:02.832819 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":849,"thread_start_us":669,"threads_started":1}
I20260807 10:48:02.833384 5932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.822360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:39525 (local address 127.0.0.1:51046)
0807 10:48:02.824370 (+ 2010us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:02.824393 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:02.824517 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:02.825376 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:02.825381 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:02.825410 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:02.825794 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:02.825803 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.827414 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.827420 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:02.829746 (+ 2326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:02.829759 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.831519 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.831526 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:02.831804 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.831853 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 10:48:02.831981 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 10:48:02.832217 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1875,"mutex_wait_us":55,"thread_start_us":1716,"threads_started":1}
I20260807 10:48:02.833395 5929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.820232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43130 (local address 127.11.46.129:45317)
0807 10:48:02.822540 (+ 2308us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:02.822560 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:02.822587 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:48:02.822673 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:02.822680 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:02.822857 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:02.824487 (+ 1630us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:02.824792 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.826521 (+ 1729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.829819 (+ 3298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.831548 (+ 1729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.832464 (+ 916us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.832783 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:02.832868 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 10:48:02.833047 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2125,"thread_start_us":1988,"threads_started":1}
I20260807 10:48:02.833876 5928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.820100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45317 (local address 127.0.0.1:43130)
0807 10:48:02.821105 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:02.821160 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:02.821348 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:02.823092 (+ 1744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:02.823100 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:02.823132 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:02.823694 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:02.823711 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.826714 (+ 3003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.826720 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:02.829541 (+ 2821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:02.829558 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.831831 (+ 2273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.831838 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:02.832012 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.832048 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 10:48:02.832138 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 10:48:02.832294 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"mutex_wait_us":87,"thread_start_us":543,"threads_started":1}
I20260807 10:48:02.834599 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:02.820266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:39517 (local address 127.0.0.1:57240)
0807 10:48:02.822130 (+ 1864us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:02.822150 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:02.822282 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:02.823364 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:02.823368 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:02.823397 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:02.824217 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:02.824237 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.826793 (+ 2556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.826797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:02.829597 (+ 2800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:02.829620 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:02.832167 (+ 2547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:02.832174 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:02.832378 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:02.832412 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 10:48:02.834215 (+ 1803us) client_negotiation.cc:240] Negotiation successful
0807 10:48:02.834348 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1724,"mutex_wait_us":194,"thread_start_us":1656,"threads_started":1}
I20260807 10:48:02.838443 5430 tablet_service.cc:1467] Processing CreateTablet for tablet 34c140f1b44642dcb0dd8c68c6b66eb0 (DEFAULT_TABLE table=test-table [id=2257cc7a3d6d45a7a9dee9ec7a722704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:02.838492 5619 tablet_service.cc:1467] Processing CreateTablet for tablet 34c140f1b44642dcb0dd8c68c6b66eb0 (DEFAULT_TABLE table=test-table [id=2257cc7a3d6d45a7a9dee9ec7a722704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:02.838332 5818 tablet_service.cc:1467] Processing CreateTablet for tablet 34c140f1b44642dcb0dd8c68c6b66eb0 (DEFAULT_TABLE table=test-table [id=2257cc7a3d6d45a7a9dee9ec7a722704]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:02.840186 5818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34c140f1b44642dcb0dd8c68c6b66eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:02.840198 5619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34c140f1b44642dcb0dd8c68c6b66eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:02.840178 5430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34c140f1b44642dcb0dd8c68c6b66eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:02.855235 5934 tablet_bootstrap.cc:492] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: Bootstrap starting.
I20260807 10:48:02.857496 5935 tablet_bootstrap.cc:492] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01: Bootstrap starting.
I20260807 10:48:02.859867 5934 tablet_bootstrap.cc:654] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:02.861433 5934 log.cc:824] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:02.861821 5935 tablet_bootstrap.cc:654] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:02.863375 5935 log.cc:824] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:02.863977 5936 tablet_bootstrap.cc:492] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: Bootstrap starting.
I20260807 10:48:02.866492 5934 tablet_bootstrap.cc:492] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: No bootstrap required, opened a new log
I20260807 10:48:02.866822 5934 ts_tablet_manager.cc:1397] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260807 10:48:02.866824 5935 tablet_bootstrap.cc:492] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01: No bootstrap required, opened a new log
I20260807 10:48:02.867132 5935 ts_tablet_manager.cc:1397] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260807 10:48:02.868578 5936 tablet_bootstrap.cc:654] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:02.870175 5936 log.cc:824] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:02.874464 5936 tablet_bootstrap.cc:492] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: No bootstrap required, opened a new log
I20260807 10:48:02.874840 5936 ts_tablet_manager.cc:1397] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260807 10:48:02.875950 5934 raft_consensus.cc:348] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3792a7934d548fd8ba73a0502a15e01" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45317 } } peers { permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 } } peers { permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 } }
I20260807 10:48:02.876400 5934 raft_consensus.cc:374] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:02.876504 5934 raft_consensus.cc:729] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45a06c4c01ed4c559fb2871299aee5c8, State: Initialized, Role: FOLLOWER
I20260807 10:48:02.877163 5934 consensus_queue.cc:260] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3792a7934d548fd8ba73a0502a15e01" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45317 } } peers { permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 } } peers { permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 } }
I20260807 10:48:02.877617 5935 raft_consensus.cc:348] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3792a7934d548fd8ba73a0502a15e01" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45317 } } peers { permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 } } peers { permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 } }
I20260807 10:48:02.878155 5935 raft_consensus.cc:374] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:02.878263 5935 raft_consensus.cc:729] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3792a7934d548fd8ba73a0502a15e01, State: Initialized, Role: FOLLOWER
I20260807 10:48:02.878621 5910 heartbeater.cc:503] Master 127.11.46.190:39637 was elected leader, sending a full tablet report...
I20260807 10:48:02.878974 5935 consensus_queue.cc:260] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3792a7934d548fd8ba73a0502a15e01" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45317 } } peers { permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 } } peers { permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 } }
I20260807 10:48:02.879297 5934 ts_tablet_manager.cc:1428] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260807 10:48:02.886030 5935 ts_tablet_manager.cc:1428] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01: Time spent starting tablet: real 0.019s user 0.014s sys 0.005s
I20260807 10:48:02.888357 5936 raft_consensus.cc:348] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3792a7934d548fd8ba73a0502a15e01" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45317 } } peers { permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 } } peers { permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 } }
I20260807 10:48:02.888984 5936 raft_consensus.cc:374] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:02.889127 5936 raft_consensus.cc:729] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc84ebbd6bbc403d929af18507a044bc, State: Initialized, Role: FOLLOWER
I20260807 10:48:02.889870 5936 consensus_queue.cc:260] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3792a7934d548fd8ba73a0502a15e01" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45317 } } peers { permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 } } peers { permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 } }
I20260807 10:48:02.891142 5718 heartbeater.cc:503] Master 127.11.46.190:39637 was elected leader, sending a full tablet report...
I20260807 10:48:02.891925 5936 ts_tablet_manager.cc:1428] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: Time spent starting tablet: real 0.017s user 0.007s sys 0.008s
W20260807 10:48:02.957280 5521 tablet.cc:2369] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:48:02.989349 5719 tablet.cc:2369] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:48:03.009902 5912 tablet.cc:2369] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:48:03.022377 5942 raft_consensus.cc:482] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:48:03.022743 5942 raft_consensus.cc:504] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3792a7934d548fd8ba73a0502a15e01" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45317 } } peers { permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 } } peers { permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 } }
I20260807 10:48:03.024762 5942 leader_election.cc:288] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45a06c4c01ed4c559fb2871299aee5c8 (127.11.46.131:39517), cc84ebbd6bbc403d929af18507a044bc (127.11.46.130:39525)
I20260807 10:48:03.032750 5933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.026424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:57691 (local address 127.11.46.130:39525)
0807 10:48:03.026660 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:03.026666 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:03.027101 (+ 435us) server_negotiation.cc:407] Connection header received
0807 10:48:03.027245 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:03.027250 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:03.027338 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:03.027407 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:03.028039 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.028958 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.030915 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.031749 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.031933 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:03.032011 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:03.032306 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 10:48:03.032455 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:48:03.032743 5931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.025289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:48665 (local address 127.11.46.131:39517)
0807 10:48:03.025585 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:03.025592 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:03.026157 (+ 565us) server_negotiation.cc:407] Connection header received
0807 10:48:03.026430 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:03.026435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:03.026515 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:03.026612 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:03.027315 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.028331 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.030760 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.031669 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.031824 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:03.031905 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:03.032287 (+ 382us) server_negotiation.cc:299] Negotiation successful
0807 10:48:03.032438 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 10:48:03.032897 5945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.025242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:39517 (local address 127.11.46.129:48665)
0807 10:48:03.026020 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:03.026038 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:03.026206 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:03.026792 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:03.026796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:03.026825 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:03.027145 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:03.027158 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.028492 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.028498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:03.030508 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:03.030527 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.031899 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.031906 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:03.032101 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:03.032135 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 10:48:03.032218 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 10:48:03.032451 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"mutex_wait_us":186,"thread_start_us":455,"threads_started":1}
I20260807 10:48:03.033354 5946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.026224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:39525 (local address 127.11.46.129:57691)
0807 10:48:03.026990 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:03.027005 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:03.027133 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:03.027455 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:03.027460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:03.027488 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:03.027884 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:03.027900 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.029129 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.029133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:03.030677 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:03.030697 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.031986 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.031992 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:03.032138 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:03.032164 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 10:48:03.032255 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 10:48:03.032438 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"mutex_wait_us":8,"thread_start_us":437,"threads_started":1}
I20260807 10:48:03.034225 5848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34c140f1b44642dcb0dd8c68c6b66eb0" candidate_uuid: "b3792a7934d548fd8ba73a0502a15e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45a06c4c01ed4c559fb2871299aee5c8" is_pre_election: true
I20260807 10:48:03.034629 5653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34c140f1b44642dcb0dd8c68c6b66eb0" candidate_uuid: "b3792a7934d548fd8ba73a0502a15e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc84ebbd6bbc403d929af18507a044bc" is_pre_election: true
I20260807 10:48:03.034804 5848 raft_consensus.cc:2454] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3792a7934d548fd8ba73a0502a15e01 in term 0.
I20260807 10:48:03.035138 5653 raft_consensus.cc:2454] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3792a7934d548fd8ba73a0502a15e01 in term 0.
I20260807 10:48:03.035567 5365 leader_election.cc:302] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45a06c4c01ed4c559fb2871299aee5c8, b3792a7934d548fd8ba73a0502a15e01; no voters:
I20260807 10:48:03.036000 5942 raft_consensus.cc:2781] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:48:03.036149 5942 raft_consensus.cc:482] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:48:03.036244 5942 raft_consensus.cc:3037] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:03.038630 5942 raft_consensus.cc:504] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3792a7934d548fd8ba73a0502a15e01" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45317 } } peers { permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 } } peers { permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 } }
I20260807 10:48:03.039299 5942 leader_election.cc:288] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [CANDIDATE]: Term 1 election: Requested vote from peers 45a06c4c01ed4c559fb2871299aee5c8 (127.11.46.131:39517), cc84ebbd6bbc403d929af18507a044bc (127.11.46.130:39525)
I20260807 10:48:03.039893 5848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34c140f1b44642dcb0dd8c68c6b66eb0" candidate_uuid: "b3792a7934d548fd8ba73a0502a15e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45a06c4c01ed4c559fb2871299aee5c8"
I20260807 10:48:03.039939 5653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34c140f1b44642dcb0dd8c68c6b66eb0" candidate_uuid: "b3792a7934d548fd8ba73a0502a15e01" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc84ebbd6bbc403d929af18507a044bc"
I20260807 10:48:03.040122 5848 raft_consensus.cc:3037] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:03.040138 5653 raft_consensus.cc:3037] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:03.042537 5848 raft_consensus.cc:2454] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3792a7934d548fd8ba73a0502a15e01 in term 1.
I20260807 10:48:03.042546 5653 raft_consensus.cc:2454] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3792a7934d548fd8ba73a0502a15e01 in term 1.
I20260807 10:48:03.043036 5365 leader_election.cc:302] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45a06c4c01ed4c559fb2871299aee5c8, b3792a7934d548fd8ba73a0502a15e01; no voters:
I20260807 10:48:03.043342 5942 raft_consensus.cc:2781] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:03.043788 5942 raft_consensus.cc:686] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 1 LEADER]: Becoming Leader. State: Replica: b3792a7934d548fd8ba73a0502a15e01, State: Running, Role: LEADER
I20260807 10:48:03.044305 5942 consensus_queue.cc:237] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3792a7934d548fd8ba73a0502a15e01" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45317 } } peers { permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 } } peers { permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 } }
I20260807 10:48:03.049507 5252 catalog_manager.cc:5495] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3792a7934d548fd8ba73a0502a15e01 (127.11.46.129). New cstate: current_term: 1 leader_uuid: "b3792a7934d548fd8ba73a0502a15e01" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3792a7934d548fd8ba73a0502a15e01" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 45317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 } health_report { overall_health: UNKNOWN } } }
I20260807 10:48:03.075063 5929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.069937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43138 (local address 127.11.46.129:45317)
0807 10:48:03.070132 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:03.070137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:03.070157 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:48:03.070340 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:03.070344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:03.070465 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:03.070605 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:48:03.070912 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.071627 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.072959 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.073421 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.073564 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:03.074029 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:48:03.074594 (+ 565us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:48:03.074712 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:03.074758 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 10:48:03.074832 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:48:03.084822 5653 raft_consensus.cc:1261] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc [term 1 FOLLOWER]: Refusing update from remote peer b3792a7934d548fd8ba73a0502a15e01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:48:03.084822 5848 raft_consensus.cc:1261] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8 [term 1 FOLLOWER]: Refusing update from remote peer b3792a7934d548fd8ba73a0502a15e01: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:48:03.086014 5947 consensus_queue.cc:1035] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc84ebbd6bbc403d929af18507a044bc" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:48:03.086465 5942 consensus_queue.cc:1035] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45a06c4c01ed4c559fb2871299aee5c8" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:48:03.101126 5956 mvcc.cc:205] Tried to move back new op lower bound from 7315864301902598144 to 7315864301753393152. Current Snapshot: MvccSnapshot[applied={T|T < 7315864301902598144}]
I20260807 10:48:03.116525 5252 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:48:03.116886 5252 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:48:03.121592 5252 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3edf4f93ca904aebab2fbdd768752295: Sending DeleteTablet for 3 replicas of tablet 34c140f1b44642dcb0dd8c68c6b66eb0
I20260807 10:48:03.123116 5818 tablet_service.cc:1514] Processing DeleteTablet for tablet 34c140f1b44642dcb0dd8c68c6b66eb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:03 UTC) from {username='slave'} at 127.0.0.1:57240
I20260807 10:48:03.123056 5430 tablet_service.cc:1514] Processing DeleteTablet for tablet 34c140f1b44642dcb0dd8c68c6b66eb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:03 UTC) from {username='slave'} at 127.0.0.1:43130
I20260807 10:48:03.123200 5619 tablet_service.cc:1514] Processing DeleteTablet for tablet 34c140f1b44642dcb0dd8c68c6b66eb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:03 UTC) from {username='slave'} at 127.0.0.1:51046
I20260807 10:48:03.127072 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 5344
I20260807 10:48:03.139312 5967 tablet_replica.cc:330] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: stopping tablet replica
I20260807 10:48:03.140221 5967 raft_consensus.cc:2229] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:48:03.141108 5967 raft_consensus.cc:2258] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:03.144063 5967 ts_tablet_manager.cc:1905] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:03.152374 5967 ts_tablet_manager.cc:1918] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:48:03.152740 5967 log.cc:1196] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/34c140f1b44642dcb0dd8c68c6b66eb0
I20260807 10:48:03.153525 5967 ts_tablet_manager.cc:1939] T 34c140f1b44642dcb0dd8c68c6b66eb0 P cc84ebbd6bbc403d929af18507a044bc: Deleting consensus metadata
I20260807 10:48:03.155812 5965 tablet_replica.cc:330] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: stopping tablet replica
I20260807 10:48:03.155817 5966 tablet_replica.cc:330] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01: stopping tablet replica
I20260807 10:48:03.156404 5966 raft_consensus.cc:2229] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:48:03.157294 5966 raft_consensus.cc:2258] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:03.157747 5234 catalog_manager.cc:4841] TS cc84ebbd6bbc403d929af18507a044bc (127.11.46.130:39525): tablet 34c140f1b44642dcb0dd8c68c6b66eb0 (table test-table [id=2257cc7a3d6d45a7a9dee9ec7a722704]) successfully deleted
I20260807 10:48:03.160959 5965 raft_consensus.cc:2229] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:48:03.161290 5966 ts_tablet_manager.cc:1905] T 34c140f1b44642dcb0dd8c68c6b66eb0 P b3792a7934d548fd8ba73a0502a15e01: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:03.161827 5965 raft_consensus.cc:2258] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:03.162744 5929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.128352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43142 (local address 127.11.46.129:45317)
0807 10:48:03.128611 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:03.128619 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:03.148904 (+ 20285us) server_negotiation.cc:407] Connection header received
0807 10:48:03.149598 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:03.149606 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:03.149775 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:03.149875 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:03.150850 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.152178 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.157848 (+ 5670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.158630 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.158783 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:03.160693 (+ 1910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:03.160708 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:03.160732 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:03.161688 (+ 956us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:03.161771 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:03.161805 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:03.161910 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:03.162238 (+ 328us) server_negotiation.cc:299] Negotiation successful
0807 10:48:03.162379 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 10:48:03.164216 5515 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:03.165103 5965 ts_tablet_manager.cc:1905] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:03.171653 5965 ts_tablet_manager.cc:1918] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:48:03.171883 5965 log.cc:1196] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/34c140f1b44642dcb0dd8c68c6b66eb0
I20260807 10:48:03.172358 5965 ts_tablet_manager.cc:1939] T 34c140f1b44642dcb0dd8c68c6b66eb0 P 45a06c4c01ed4c559fb2871299aee5c8: Deleting consensus metadata
I20260807 10:48:03.174284 5234 catalog_manager.cc:4841] TS 45a06c4c01ed4c559fb2871299aee5c8 (127.11.46.131:39517): tablet 34c140f1b44642dcb0dd8c68c6b66eb0 (table test-table [id=2257cc7a3d6d45a7a9dee9ec7a722704]) successfully deleted
I20260807 10:48:03.274637 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 5344
I20260807 10:48:03.306922 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 5527
W20260807 10:48:03.306910 5233 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.46.129:45317 (error 108)
I20260807 10:48:03.308818 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.308310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45317 (local address 127.0.0.1:43154)
0807 10:48:03.308519 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:03.308653 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260807 10:48:03.309083 5233 catalog_manager.cc:4584] TS b3792a7934d548fd8ba73a0502a15e01 (127.11.46.129:45317): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 34c140f1b44642dcb0dd8c68c6b66eb0: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45317: connect: Connection refused (error 111)
I20260807 10:48:03.314219 5933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.307836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51060 (local address 127.11.46.130:39525)
0807 10:48:03.308035 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:03.308041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:03.308066 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:48:03.308274 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:03.308278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:03.308392 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:03.308510 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:03.308931 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.309832 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.311144 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.311576 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.311674 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:03.312697 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:03.312706 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:03.312722 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:03.313372 (+ 650us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:03.313436 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:03.313564 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:03.313668 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:03.313801 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 10:48:03.313926 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 10:48:03.315012 5711 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:03.362797 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.362286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45317 (local address 127.0.0.1:43162)
0807 10:48:03.362531 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:03.362634 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260807 10:48:03.363886 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.363508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45317 (local address 127.0.0.1:43176)
0807 10:48:03.363668 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:03.363747 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 10:48:03.409917 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 5527
I20260807 10:48:03.424525 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.424021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45317 (local address 127.0.0.1:43178)
0807 10:48:03.424240 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:03.424333 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 10:48:03.425707 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.425336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45317 (local address 127.0.0.1:43192)
0807 10:48:03.425498 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:03.425581 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 10:48:03.436882 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 5723
I20260807 10:48:03.443931 5931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.437736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57252 (local address 127.11.46.131:39517)
0807 10:48:03.437961 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:03.437966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:03.437988 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:48:03.438107 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:03.438110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:03.438207 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:03.438296 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:03.438698 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.439462 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.440778 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:03.441195 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:03.441298 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:03.442568 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:03.442578 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:03.442595 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:03.443230 (+ 635us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:03.443286 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:03.443309 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:03.443406 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:03.443518 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 10:48:03.443644 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 10:48:03.444691 5902 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:03.507011 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.506324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45317 (local address 127.0.0.1:43202)
0807 10:48:03.506610 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:03.506770 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260807 10:48:03.508620 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:03.508058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:45317 (local address 127.0.0.1:43212)
0807 10:48:03.508319 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:03.508436 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:45317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260807 10:48:03.536033 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 5723
I20260807 10:48:03.561177 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 5210
I20260807 10:48:03.562492 5298 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:03.676368 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 5210
2026-08-07T10:48:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3270 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:03 dist-test-slave-42z9 krb5kdc[5983](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:03 dist-test-slave-42z9 krb5kdc[5983](info): set up 2 sockets
Aug 07 10:48:03 dist-test-slave-42z9 krb5kdc[5983](info): commencing operation
krb5kdc: starting...
W20260807 10:48:04.934289 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.000s sys 0.065s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:05 dist-test-slave-42z9 krb5kdc[5983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:48:05.333171 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:40183
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:40183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:05.723491 5998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:05.723841 5998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:05.723937 5998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:05.731709 5998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:05.731859 5998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:05.731914 5998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:05.731976 5998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:05.732045 5998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:05.742904 5998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:40183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:40183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:05.744387 5998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:05.745940 5998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:05.759374 6008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:05.759281 6012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:05.759353 6009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:05.762965 5998 server_base.cc:1034] running on GCE node
I20260807 10:48:05.763913 5998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:05.765628 5998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:05.766888 5998 hybrid_clock.cc:648] HybridClock initialized: now 1786099685766837 us; error 43 us; skew 500 ppm
I20260807 10:48:05.767315 5998 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:05 dist-test-slave-42z9 krb5kdc[5983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099685, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:05.777814 5998 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:48:05.779845 5998 webserver.cc:460] Webserver started at http://127.11.46.190:42879/ using document root <none> and password file <none>
I20260807 10:48:05.780719 5998 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:05.780861 5998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:05.781208 5998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:05.784792 5998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "792f98c914e64207b6734633d36830ac"
format_stamp: "Formatted at 2026-08-07 10:48:05 on dist-test-slave-42z9"
server_key: "c47cc03037d5ece986854cdacc228534"
server_key_iv: "631176a781b748d524f115c164092907"
server_key_version: "encryptionkey@0"
I20260807 10:48:05.785763 5998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "792f98c914e64207b6734633d36830ac"
format_stamp: "Formatted at 2026-08-07 10:48:05 on dist-test-slave-42z9"
server_key: "c47cc03037d5ece986854cdacc228534"
server_key_iv: "631176a781b748d524f115c164092907"
server_key_version: "encryptionkey@0"
I20260807 10:48:05.792045 5998 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:48:05.796413 6020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:05.798074 5998 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 10:48:05.798298 5998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "792f98c914e64207b6734633d36830ac"
format_stamp: "Formatted at 2026-08-07 10:48:05 on dist-test-slave-42z9"
server_key: "c47cc03037d5ece986854cdacc228534"
server_key_iv: "631176a781b748d524f115c164092907"
server_key_version: "encryptionkey@0"
I20260807 10:48:05.798534 5998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:05.828136 5998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:05.832840 5998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:05.833176 5998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:05.853771 5998 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:40183
I20260807 10:48:05.853806 6101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:40183 every 8 connection(s)
I20260807 10:48:05.855402 5998 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:05.859639 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 5998
I20260807 10:48:05.859810 6104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:05.859848 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:05.860385 11450 external_mini_cluster.cc:1428] Setting key ee56ea1a1dffc6c3acaf66f0e608af1e
I20260807 10:48:05.875699 6104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac: Bootstrap starting.
Aug 07 10:48:05 dist-test-slave-42z9 krb5kdc[5983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:48:05.880000 6104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:05.881349 6104 log.cc:824] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:05.885061 6104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac: No bootstrap required, opened a new log
I20260807 10:48:05.885428 6108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:05.862409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44170 (local address 127.11.46.190:40183)
0807 10:48:05.863278 (+ 869us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:05.863290 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:05.863341 (+ 51us) server_negotiation.cc:407] Connection header received
0807 10:48:05.864995 (+ 1654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:05.865021 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:05.865477 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:05.865842 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:05.867816 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:05.869148 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:05.871056 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:05.871825 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:05.871981 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:05.877177 (+ 5196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:05.877186 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:05.877205 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:05.877253 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:05.880619 (+ 3366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:05.881641 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:05.881649 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:05.881656 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:05.881846 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:05.882328 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:05.882337 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:05.882341 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:05.883111 (+ 770us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:05.883351 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:05.883864 (+ 513us) server_negotiation.cc:299] Negotiation successful
0807 10:48:05.884256 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":407,"threads_started":1}
I20260807 10:48:05.893905 6104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "792f98c914e64207b6734633d36830ac" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40183 } }
I20260807 10:48:05.894353 6104 raft_consensus.cc:374] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:05.894454 6104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 792f98c914e64207b6734633d36830ac, State: Initialized, Role: FOLLOWER
I20260807 10:48:05.895087 6104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "792f98c914e64207b6734633d36830ac" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40183 } }
I20260807 10:48:05.895328 6104 raft_consensus.cc:388] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:05.895476 6104 raft_consensus.cc:482] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:05.895646 6104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:05.898005 6104 raft_consensus.cc:504] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "792f98c914e64207b6734633d36830ac" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40183 } }
I20260807 10:48:05.898576 6104 leader_election.cc:302] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 792f98c914e64207b6734633d36830ac; no voters:
I20260807 10:48:05.899317 6104 leader_election.cc:288] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:05.899505 6115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:05.900198 6115 raft_consensus.cc:686] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [term 1 LEADER]: Becoming Leader. State: Replica: 792f98c914e64207b6734633d36830ac, State: Running, Role: LEADER
I20260807 10:48:05.900739 6115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "792f98c914e64207b6734633d36830ac" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40183 } }
I20260807 10:48:05.901643 6104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:05.903782 6116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "792f98c914e64207b6734633d36830ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "792f98c914e64207b6734633d36830ac" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40183 } } }
I20260807 10:48:05.904263 6116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:05.903756 6117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 792f98c914e64207b6734633d36830ac. Latest consensus state: current_term: 1 leader_uuid: "792f98c914e64207b6734633d36830ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "792f98c914e64207b6734633d36830ac" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 40183 } } }
I20260807 10:48:05.904758 6117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:05.907591 6125 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:05.914628 6125 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:05.925918 6125 catalog_manager.cc:1347] Generated new cluster ID: 179b9ab43a904e69b5aa66d33b5d2271
I20260807 10:48:05.926050 6125 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:05.941267 6125 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:05.942824 6125 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:05.955878 6125 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac: Generated new TSK 0
I20260807 10:48:05.956889 6125 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:48:06.056535 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40183
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:06.466192 6151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:06.466553 6151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:06.466708 6151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:06.474570 6151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:06.474718 6151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:06.474884 6151 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:48:06.485894 6151 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40183
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:06.487491 6151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:06.489050 6151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:06.503752 6161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:06.503768 6162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:06.503826 6165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:06.504674 6151 server_base.cc:1034] running on GCE node
I20260807 10:48:06.505339 6151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:06.506407 6151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:06.507633 6151 hybrid_clock.cc:648] HybridClock initialized: now 1786099686507576 us; error 47 us; skew 500 ppm
I20260807 10:48:06.507987 6151 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:06 dist-test-slave-42z9 krb5kdc[5983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099686, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:06.511466 6151 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:48:06.513070 6151 webserver.cc:460] Webserver started at http://127.11.46.129:44991/ using document root <none> and password file <none>
I20260807 10:48:06.513912 6151 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:06.514030 6151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:06.514317 6151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:06.517597 6151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "9702899228a642ca848abf498d9d4c33"
format_stamp: "Formatted at 2026-08-07 10:48:06 on dist-test-slave-42z9"
server_key: "08674ebcd50fcc4376a24b2fb8dd75f4"
server_key_iv: "162c982bd359b94a329d651086bc4c2f"
server_key_version: "encryptionkey@0"
I20260807 10:48:06.518455 6151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "9702899228a642ca848abf498d9d4c33"
format_stamp: "Formatted at 2026-08-07 10:48:06 on dist-test-slave-42z9"
server_key: "08674ebcd50fcc4376a24b2fb8dd75f4"
server_key_iv: "162c982bd359b94a329d651086bc4c2f"
server_key_version: "encryptionkey@0"
I20260807 10:48:06.524557 6151 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260807 10:48:06.528476 6174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:06.530072 6151 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:48:06.530254 6151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "9702899228a642ca848abf498d9d4c33"
format_stamp: "Formatted at 2026-08-07 10:48:06 on dist-test-slave-42z9"
server_key: "08674ebcd50fcc4376a24b2fb8dd75f4"
server_key_iv: "162c982bd359b94a329d651086bc4c2f"
server_key_version: "encryptionkey@0"
I20260807 10:48:06.530467 6151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:06.550354 6151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:06.555075 6151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:06.555372 6151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:06.556478 6151 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:06.558364 6151 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:06.558454 6151 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:06.558570 6151 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:06.558615 6151 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:06.593657 6151 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:46525
I20260807 10:48:06.593708 6337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:46525 every 8 connection(s)
I20260807 10:48:06.595142 6151 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:48:06.598105 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 6151
I20260807 10:48:06.598291 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:48:06.598856 11450 external_mini_cluster.cc:1428] Setting key 224d6496ff25e6695c88610592f75fde
Aug 07 10:48:06 dist-test-slave-42z9 krb5kdc[5983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099686, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:48:06.619549 6343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:06.598012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:39617 (local address 127.11.46.190:40183)
0807 10:48:06.598635 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:06.598642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:06.599799 (+ 1157us) server_negotiation.cc:407] Connection header received
0807 10:48:06.602281 (+ 2482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:06.602286 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:06.602367 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:06.602471 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:06.604774 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:06.605587 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:06.607797 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:06.608211 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:06.608306 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:06.612736 (+ 4430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:06.612744 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:06.612749 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:06.612796 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:06.615886 (+ 3090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:06.616847 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:06.616853 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:06.616856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:06.617031 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:06.617515 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:06.617520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:06.617523 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:06.617905 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:06.618060 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:06.618908 (+ 848us) server_negotiation.cc:299] Negotiation successful
0807 10:48:06.619169 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":325,"threads_started":1}
I20260807 10:48:06.620769 6345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:06.598659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40183 (local address 127.11.46.129:39617)
0807 10:48:06.599604 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:06.599658 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:06.601914 (+ 2256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:06.602799 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:06.602812 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:06.603659 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:06.604567 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:06.604597 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:06.605774 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:06.605779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:06.607651 (+ 1872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:06.607670 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:06.608469 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:06.608476 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:06.608790 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:06.609595 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:48:06.609635 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:06.612407 (+ 2772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:06.616093 (+ 3686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:06.616104 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:06.616124 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:06.616689 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:06.617144 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:06.617147 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:06.617149 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:06.617372 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:06.618054 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:06.618061 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:06.618482 (+ 421us) client_negotiation.cc:769] Sending connection context
0807 10:48:06.618758 (+ 276us) client_negotiation.cc:240] Negotiation successful
0807 10:48:06.619242 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":324,"threads_started":1}
I20260807 10:48:06.622612 6339 heartbeater.cc:347] Connected to a master server at 127.11.46.190:40183
I20260807 10:48:06.622951 6339 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:06.623822 6339 heartbeater.cc:511] Master 127.11.46.190:40183 requested a full tablet report, sending...
I20260807 10:48:06.626619 6046 ts_manager.cc:194] Registered new tserver with Master: 9702899228a642ca848abf498d9d4c33 (127.11.46.129:46525)
I20260807 10:48:06.628753 6046 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:39617
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:48:06.684599 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40183
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:07.071985 6348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:07.072295 6348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:07.072403 6348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:07.080101 6348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:07.080261 6348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:07.080385 6348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:48:07.091120 6348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40183
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:07.092679 6348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:07.094278 6348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:07.109755 6354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:07.109791 6355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:07.109709 6357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:07.111209 6348 server_base.cc:1034] running on GCE node
I20260807 10:48:07.111946 6348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:07.113144 6348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:07.114390 6348 hybrid_clock.cc:648] HybridClock initialized: now 1786099687114314 us; error 71 us; skew 500 ppm
I20260807 10:48:07.114794 6348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:07 dist-test-slave-42z9 krb5kdc[5983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099687, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:07.118299 6348 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:48:07.120155 6348 webserver.cc:460] Webserver started at http://127.11.46.130:38249/ using document root <none> and password file <none>
I20260807 10:48:07.121030 6348 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:07.121165 6348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:07.121559 6348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:07.125128 6348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae"
format_stamp: "Formatted at 2026-08-07 10:48:07 on dist-test-slave-42z9"
server_key: "05e82c82ab4310109c6c41b8d419f79b"
server_key_iv: "24f3fe9116601e8aa4809991a87f0c5b"
server_key_version: "encryptionkey@0"
I20260807 10:48:07.126112 6348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae"
format_stamp: "Formatted at 2026-08-07 10:48:07 on dist-test-slave-42z9"
server_key: "05e82c82ab4310109c6c41b8d419f79b"
server_key_iv: "24f3fe9116601e8aa4809991a87f0c5b"
server_key_version: "encryptionkey@0"
I20260807 10:48:07.132520 6348 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260807 10:48:07.136915 6365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:07.138482 6348 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 10:48:07.138674 6348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae"
format_stamp: "Formatted at 2026-08-07 10:48:07 on dist-test-slave-42z9"
server_key: "05e82c82ab4310109c6c41b8d419f79b"
server_key_iv: "24f3fe9116601e8aa4809991a87f0c5b"
server_key_version: "encryptionkey@0"
I20260807 10:48:07.138907 6348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:07.160169 6348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:07.164852 6348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:07.165179 6348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:07.166400 6348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:07.168010 6348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:07.168123 6348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:07.168262 6348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:07.168318 6348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:07.202730 6348 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:38529
I20260807 10:48:07.202754 6529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:38529 every 8 connection(s)
I20260807 10:48:07.204376 6348 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:48:07.205477 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 6348
I20260807 10:48:07.205670 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:48:07.206147 11450 external_mini_cluster.cc:1428] Setting key 2fc206a881693a3ab6466b92fe33ddb1
Aug 07 10:48:07 dist-test-slave-42z9 krb5kdc[5983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099687, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:48:07.227370 6532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.207376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:54843 (local address 127.11.46.190:40183)
0807 10:48:07.207861 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:07.207868 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:07.209302 (+ 1434us) server_negotiation.cc:407] Connection header received
0807 10:48:07.211417 (+ 2115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:07.211422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:07.211519 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:07.211620 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:07.213397 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.214212 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.215992 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.216476 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.216609 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.220813 (+ 4204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:07.220820 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:07.220823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:07.220867 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:07.223721 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:07.224667 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:07.224673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:07.224675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:07.224824 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:07.225346 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:07.225350 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:07.225353 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:07.225720 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:07.225884 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:07.226711 (+ 827us) server_negotiation.cc:299] Negotiation successful
0807 10:48:07.226977 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":236,"threads_started":1}
I20260807 10:48:07.228484 6533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.208153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40183 (local address 127.11.46.130:54843)
0807 10:48:07.209141 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:07.209195 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:07.211102 (+ 1907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:07.211914 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:07.211924 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:07.212530 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:07.213185 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:07.213206 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.214406 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.214411 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:07.215804 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:07.215822 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.216768 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.216777 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:07.217030 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.217805 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:48:07.217834 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:07.220482 (+ 2648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:07.223931 (+ 3449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:07.223941 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:07.223959 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:07.224516 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:07.224966 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:07.224970 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:07.224973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:07.225218 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:07.225864 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:07.225873 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:07.226296 (+ 423us) client_negotiation.cc:769] Sending connection context
0807 10:48:07.226586 (+ 290us) client_negotiation.cc:240] Negotiation successful
0807 10:48:07.227207 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":405,"threads_started":1}
I20260807 10:48:07.230288 6530 heartbeater.cc:347] Connected to a master server at 127.11.46.190:40183
I20260807 10:48:07.230652 6530 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:07.231514 6530 heartbeater.cc:511] Master 127.11.46.190:40183 requested a full tablet report, sending...
I20260807 10:48:07.233381 6046 ts_manager.cc:194] Registered new tserver with Master: fdd60046a60a4bc981a7f1b4d33bc2ae (127.11.46.130:38529)
I20260807 10:48:07.234592 6046 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:54843
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:48:07.288690 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40183
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:48:07.632841 6339 heartbeater.cc:503] Master 127.11.46.190:40183 was elected leader, sending a full tablet report...
W20260807 10:48:07.680275 6545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:07.680634 6545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:07.680771 6545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:07.688434 6545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:07.688568 6545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:07.688725 6545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:48:07.699265 6545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:40183
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:07.700742 6545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:07.702304 6545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:07.716660 6553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:07.716820 6551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:07.716784 6555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:07.717958 6545 server_base.cc:1034] running on GCE node
I20260807 10:48:07.718694 6545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:07.719818 6545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:07.721055 6545 hybrid_clock.cc:648] HybridClock initialized: now 1786099687720981 us; error 60 us; skew 500 ppm
I20260807 10:48:07.721421 6545 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:07 dist-test-slave-42z9 krb5kdc[5983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099687, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:07.725208 6545 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:48:07.726970 6545 webserver.cc:460] Webserver started at http://127.11.46.131:39019/ using document root <none> and password file <none>
I20260807 10:48:07.727761 6545 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:07.727886 6545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:07.728224 6545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:07.731600 6545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "b02765edca4a4e549670ba9b2d6b95cc"
format_stamp: "Formatted at 2026-08-07 10:48:07 on dist-test-slave-42z9"
server_key: "43f5560eb6f31eb4ef98bc608f109bfe"
server_key_iv: "155d77ab3eb467046c3da4edffdfe5f4"
server_key_version: "encryptionkey@0"
I20260807 10:48:07.732465 6545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "b02765edca4a4e549670ba9b2d6b95cc"
format_stamp: "Formatted at 2026-08-07 10:48:07 on dist-test-slave-42z9"
server_key: "43f5560eb6f31eb4ef98bc608f109bfe"
server_key_iv: "155d77ab3eb467046c3da4edffdfe5f4"
server_key_version: "encryptionkey@0"
I20260807 10:48:07.738443 6545 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 10:48:07.742729 6571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:07.744360 6545 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260807 10:48:07.744568 6545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "b02765edca4a4e549670ba9b2d6b95cc"
format_stamp: "Formatted at 2026-08-07 10:48:07 on dist-test-slave-42z9"
server_key: "43f5560eb6f31eb4ef98bc608f109bfe"
server_key_iv: "155d77ab3eb467046c3da4edffdfe5f4"
server_key_version: "encryptionkey@0"
I20260807 10:48:07.744791 6545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:07.764189 6545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:07.768689 6545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:07.769003 6545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:07.770234 6545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:07.772058 6545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:07.772156 6545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:07.772276 6545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:07.772334 6545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:07.807634 6545 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:44433
I20260807 10:48:07.807672 6742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:44433 every 8 connection(s)
I20260807 10:48:07.809211 6545 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:48:07.810016 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 6545
I20260807 10:48:07.810212 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:48:07.810868 11450 external_mini_cluster.cc:1428] Setting key 69df7c249cd9349ec5b2964aa53ab1d4
Aug 07 10:48:07 dist-test-slave-42z9 krb5kdc[5983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099687, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:48:07.832181 6746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.812233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:56049 (local address 127.11.46.190:40183)
0807 10:48:07.812774 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:07.812781 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:07.814303 (+ 1522us) server_negotiation.cc:407] Connection header received
0807 10:48:07.816339 (+ 2036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:07.816343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:07.816438 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:07.816538 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:07.818349 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.819156 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.820917 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.821316 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.821414 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.825560 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:07.825566 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:07.825570 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:07.825614 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:07.828460 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:07.829372 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:07.829380 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:07.829382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:07.829567 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:07.830104 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:07.830108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:07.830110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:07.830434 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:07.830593 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:07.831472 (+ 879us) server_negotiation.cc:299] Negotiation successful
0807 10:48:07.831750 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":282,"threads_started":1}
I20260807 10:48:07.833299 6747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.813094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:40183 (local address 127.11.46.131:56049)
0807 10:48:07.814106 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:07.814172 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:07.816036 (+ 1864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:07.816780 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:07.816789 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:07.817418 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:07.818154 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:07.818177 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.819400 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.819405 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:07.820772 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:07.820789 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.821594 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.821602 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:07.821838 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.822609 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:48:07.822647 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:07.825243 (+ 2596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:07.828662 (+ 3419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:07.828674 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:07.828692 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:07.829235 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:07.829695 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:07.829702 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:07.829705 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:07.829966 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:07.830586 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:07.830596 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:07.831031 (+ 435us) client_negotiation.cc:769] Sending connection context
0807 10:48:07.831330 (+ 299us) client_negotiation.cc:240] Negotiation successful
0807 10:48:07.831983 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":370,"threads_started":1}
I20260807 10:48:07.835032 6743 heartbeater.cc:347] Connected to a master server at 127.11.46.190:40183
I20260807 10:48:07.835392 6743 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:07.836241 6743 heartbeater.cc:511] Master 127.11.46.190:40183 requested a full tablet report, sending...
I20260807 10:48:07.838081 6046 ts_manager.cc:194] Registered new tserver with Master: b02765edca4a4e549670ba9b2d6b95cc (127.11.46.131:44433)
I20260807 10:48:07.839178 6046 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:56049
I20260807 10:48:07.839975 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:48:07.860780 6746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.845296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44186 (local address 127.11.46.190:40183)
0807 10:48:07.845525 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:07.845530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:07.845959 (+ 429us) server_negotiation.cc:407] Connection header received
0807 10:48:07.846174 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:07.846179 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:07.846260 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:07.846404 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:07.847884 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.848765 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.850463 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.850899 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.851013 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.854177 (+ 3164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:07.854183 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:07.854187 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:07.854231 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:07.857133 (+ 2902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:07.858456 (+ 1323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:07.858461 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:07.858463 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:07.858629 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:07.859139 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:07.859142 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:07.859144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:07.859560 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:07.859784 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:07.860276 (+ 492us) server_negotiation.cc:299] Negotiation successful
0807 10:48:07.860471 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 10:48:07.865583 6046 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44186:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:48:07.872993 6046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:48:07.911116 6759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.887675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:46525 (local address 127.0.0.1:34014)
0807 10:48:07.900189 (+ 12514us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:07.900253 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:07.900574 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:07.902504 (+ 1930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:07.902515 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:07.902558 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:07.903205 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:07.903225 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.905660 (+ 2435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.905666 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:07.908097 (+ 2431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:07.908112 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.910025 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.910033 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:07.910251 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.910317 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 10:48:07.910466 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 10:48:07.910704 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12126,"thread_start_us":13284,"threads_started":1}
I20260807 10:48:07.911810 6764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.887846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34014 (local address 127.11.46.129:46525)
0807 10:48:07.899557 (+ 11711us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:07.899569 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:07.901640 (+ 2071us) server_negotiation.cc:407] Connection header received
0807 10:48:07.901795 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:07.901806 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:07.902174 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:07.903493 (+ 1319us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:07.903827 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.905481 (+ 1654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.908301 (+ 2820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.909722 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.910898 (+ 1176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.911185 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:07.911282 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 10:48:07.911473 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11441,"thread_start_us":11260,"threads_started":1}
I20260807 10:48:07.913069 6760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.887775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:44433 (local address 127.0.0.1:52138)
0807 10:48:07.901301 (+ 13526us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:07.901324 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:07.901476 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:07.905010 (+ 3534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:07.905016 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:07.905051 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:07.905572 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:07.905587 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.907642 (+ 2055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.907648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:07.909957 (+ 2309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:07.909970 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.912170 (+ 2200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.912176 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:07.912350 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.912385 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 10:48:07.912487 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 10:48:07.912631 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13379,"mutex_wait_us":83,"thread_start_us":11884,"threads_started":1}
I20260807 10:48:07.913154 6766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.888348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52138 (local address 127.11.46.131:44433)
0807 10:48:07.904033 (+ 15685us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:07.904041 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:07.904076 (+ 35us) server_negotiation.cc:407] Connection header received
0807 10:48:07.904182 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:07.904190 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:07.904437 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:07.904674 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:07.905800 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.907472 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.910162 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.911667 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.911799 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.912030 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:07.912606 (+ 576us) server_negotiation.cc:299] Negotiation successful
0807 10:48:07.912795 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15488,"thread_start_us":15325,"threads_started":1}
I20260807 10:48:07.915376 6769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.889059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58114 (local address 127.11.46.130:38529)
0807 10:48:07.903009 (+ 13950us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:07.903021 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:07.903981 (+ 960us) server_negotiation.cc:407] Connection header received
0807 10:48:07.904089 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:07.904095 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:07.904322 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:07.904567 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:07.905734 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.907143 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.911056 (+ 3913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.912419 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.912571 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.912765 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:07.914859 (+ 2094us) server_negotiation.cc:299] Negotiation successful
0807 10:48:07.915067 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13737,"thread_start_us":13623,"threads_started":1}
I20260807 10:48:07.915815 6767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:07.888438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:38529 (local address 127.0.0.1:58114)
0807 10:48:07.903640 (+ 15202us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:07.903664 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:07.903805 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:07.904842 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:07.904847 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:07.904878 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:07.905435 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:07.905490 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.907292 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.907296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:07.909783 (+ 2487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:07.909810 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:07.912951 (+ 3141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:07.912958 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:07.914305 (+ 1347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:07.914342 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:48:07.914443 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 10:48:07.914595 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14993,"mutex_wait_us":39,"spinlock_wait_cycles":2432,"thread_start_us":14775,"threads_started":1}
I20260807 10:48:07.916529 6243 tablet_service.cc:1467] Processing CreateTablet for tablet 0a1ce2829fb442588b3c4e70548e22f4 (DEFAULT_TABLE table=test-table [id=9eb3f68666744d69a62577d72c518e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:07.916936 6643 tablet_service.cc:1467] Processing CreateTablet for tablet 0a1ce2829fb442588b3c4e70548e22f4 (DEFAULT_TABLE table=test-table [id=9eb3f68666744d69a62577d72c518e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:07.918203 6243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a1ce2829fb442588b3c4e70548e22f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:07.918608 6643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a1ce2829fb442588b3c4e70548e22f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:07.920140 6434 tablet_service.cc:1467] Processing CreateTablet for tablet 0a1ce2829fb442588b3c4e70548e22f4 (DEFAULT_TABLE table=test-table [id=9eb3f68666744d69a62577d72c518e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:07.921877 6434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a1ce2829fb442588b3c4e70548e22f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:07.931684 6770 tablet_bootstrap.cc:492] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: Bootstrap starting.
I20260807 10:48:07.934993 6772 tablet_bootstrap.cc:492] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: Bootstrap starting.
I20260807 10:48:07.937608 6770 tablet_bootstrap.cc:654] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:07.938372 6774 tablet_bootstrap.cc:492] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: Bootstrap starting.
I20260807 10:48:07.939486 6772 tablet_bootstrap.cc:654] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:07.939891 6770 log.cc:824] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:07.940936 6772 log.cc:824] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:07.942185 6774 tablet_bootstrap.cc:654] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:07.944178 6774 log.cc:824] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:07.945526 6772 tablet_bootstrap.cc:492] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: No bootstrap required, opened a new log
I20260807 10:48:07.945884 6770 tablet_bootstrap.cc:492] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: No bootstrap required, opened a new log
I20260807 10:48:07.945967 6772 ts_tablet_manager.cc:1397] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260807 10:48:07.946182 6770 ts_tablet_manager.cc:1397] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.007s
I20260807 10:48:07.948072 6774 tablet_bootstrap.cc:492] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: No bootstrap required, opened a new log
I20260807 10:48:07.948323 6774 ts_tablet_manager.cc:1397] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 10:48:07.956465 6774 raft_consensus.cc:348] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 } } peers { permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 } } peers { permanent_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38529 } }
I20260807 10:48:07.957406 6774 raft_consensus.cc:374] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:07.957669 6774 raft_consensus.cc:729] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdd60046a60a4bc981a7f1b4d33bc2ae, State: Initialized, Role: FOLLOWER
I20260807 10:48:07.957705 6770 raft_consensus.cc:348] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 } } peers { permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 } } peers { permanent_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38529 } }
I20260807 10:48:07.957698 6772 raft_consensus.cc:348] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 } } peers { permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 } } peers { permanent_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38529 } }
I20260807 10:48:07.958218 6770 raft_consensus.cc:374] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:07.958218 6772 raft_consensus.cc:374] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:07.958340 6772 raft_consensus.cc:729] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02765edca4a4e549670ba9b2d6b95cc, State: Initialized, Role: FOLLOWER
I20260807 10:48:07.958333 6770 raft_consensus.cc:729] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9702899228a642ca848abf498d9d4c33, State: Initialized, Role: FOLLOWER
I20260807 10:48:07.958914 6774 consensus_queue.cc:260] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 } } peers { permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 } } peers { permanent_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38529 } }
I20260807 10:48:07.959102 6772 consensus_queue.cc:260] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 } } peers { permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 } } peers { permanent_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38529 } }
I20260807 10:48:07.959102 6770 consensus_queue.cc:260] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 } } peers { permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 } } peers { permanent_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38529 } }
I20260807 10:48:07.963409 6770 ts_tablet_manager.cc:1428] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: Time spent starting tablet: real 0.017s user 0.015s sys 0.000s
I20260807 10:48:07.964735 6743 heartbeater.cc:503] Master 127.11.46.190:40183 was elected leader, sending a full tablet report...
I20260807 10:48:07.965886 6774 ts_tablet_manager.cc:1428] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: Time spent starting tablet: real 0.017s user 0.014s sys 0.004s
I20260807 10:48:07.965911 6772 ts_tablet_manager.cc:1428] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: Time spent starting tablet: real 0.020s user 0.014s sys 0.004s
I20260807 10:48:07.966435 6530 heartbeater.cc:503] Master 127.11.46.190:40183 was elected leader, sending a full tablet report...
W20260807 10:48:08.061365 6744 tablet.cc:2369] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:48:08.098117 6342 tablet.cc:2369] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 10:48:08.206895 6531 tablet.cc:2369] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:48:08.334043 6779 raft_consensus.cc:482] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:48:08.334396 6779 raft_consensus.cc:504] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 } } peers { permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 } } peers { permanent_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38529 } }
I20260807 10:48:08.336409 6779 leader_election.cc:288] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9702899228a642ca848abf498d9d4c33 (127.11.46.129:46525), b02765edca4a4e549670ba9b2d6b95cc (127.11.46.131:44433)
I20260807 10:48:08.346232 6764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:08.336913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:49671 (local address 127.11.46.129:46525)
0807 10:48:08.337129 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:08.337135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:08.337903 (+ 768us) server_negotiation.cc:407] Connection header received
0807 10:48:08.338135 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:08.338140 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:08.338224 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:08.338341 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:08.339136 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.340270 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.343493 (+ 3223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.344833 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.345054 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:08.345141 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:08.345874 (+ 733us) server_negotiation.cc:299] Negotiation successful
0807 10:48:08.346010 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:48:08.346438 6788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:08.336841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:44433 (local address 127.11.46.130:45051)
0807 10:48:08.337774 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:08.337788 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:08.337957 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:08.338373 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:08.338377 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:08.338409 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:08.338848 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:08.338865 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.340435 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.340440 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:08.343235 (+ 2795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:08.343263 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.345151 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.345160 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:08.345485 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:08.345587 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 10:48:08.345711 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 10:48:08.345924 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":834,"mutex_wait_us":278,"thread_start_us":525,"threads_started":1}
I20260807 10:48:08.346459 6782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:08.336734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:46525 (local address 127.11.46.130:49671)
0807 10:48:08.337736 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:08.337763 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:08.338006 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:08.338373 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:08.338377 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:08.338424 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:08.338981 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:08.338993 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.340431 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.340437 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:08.343247 (+ 2810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:08.343263 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.345152 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.345160 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:08.345485 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:08.345587 (+ 102us) client_negotiation.cc:769] Sending connection context
0807 10:48:08.345711 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 10:48:08.345924 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"mutex_wait_us":240,"spinlock_wait_cycles":65664,"thread_start_us":576,"threads_started":1}
I20260807 10:48:08.346980 6766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:08.336918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:45051 (local address 127.11.46.131:44433)
0807 10:48:08.337117 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:08.337124 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:08.337902 (+ 778us) server_negotiation.cc:407] Connection header received
0807 10:48:08.338129 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:08.338136 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:08.338224 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:08.338342 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:08.339081 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.340270 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.343521 (+ 3251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.344831 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.345064 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:08.345141 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:08.346537 (+ 1396us) server_negotiation.cc:299] Negotiation successful
0807 10:48:08.346714 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:48:08.347929 6674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a1ce2829fb442588b3c4e70548e22f4" candidate_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02765edca4a4e549670ba9b2d6b95cc" is_pre_election: true
I20260807 10:48:08.347936 6270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a1ce2829fb442588b3c4e70548e22f4" candidate_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9702899228a642ca848abf498d9d4c33" is_pre_election: true
I20260807 10:48:08.348588 6674 raft_consensus.cc:2454] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdd60046a60a4bc981a7f1b4d33bc2ae in term 0.
I20260807 10:48:08.348589 6270 raft_consensus.cc:2454] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdd60046a60a4bc981a7f1b4d33bc2ae in term 0.
I20260807 10:48:08.349418 6367 leader_election.cc:302] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9702899228a642ca848abf498d9d4c33, fdd60046a60a4bc981a7f1b4d33bc2ae; no voters:
I20260807 10:48:08.349951 6779 raft_consensus.cc:2781] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:48:08.350104 6779 raft_consensus.cc:482] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:48:08.350180 6779 raft_consensus.cc:3037] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:08.352556 6779 raft_consensus.cc:504] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 } } peers { permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 } } peers { permanent_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38529 } }
I20260807 10:48:08.353257 6779 leader_election.cc:288] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [CANDIDATE]: Term 1 election: Requested vote from peers 9702899228a642ca848abf498d9d4c33 (127.11.46.129:46525), b02765edca4a4e549670ba9b2d6b95cc (127.11.46.131:44433)
I20260807 10:48:08.353962 6674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a1ce2829fb442588b3c4e70548e22f4" candidate_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02765edca4a4e549670ba9b2d6b95cc"
I20260807 10:48:08.353976 6270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a1ce2829fb442588b3c4e70548e22f4" candidate_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9702899228a642ca848abf498d9d4c33"
I20260807 10:48:08.354220 6270 raft_consensus.cc:3037] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:08.354214 6674 raft_consensus.cc:3037] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:08.356653 6674 raft_consensus.cc:2454] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdd60046a60a4bc981a7f1b4d33bc2ae in term 1.
I20260807 10:48:08.356658 6270 raft_consensus.cc:2454] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdd60046a60a4bc981a7f1b4d33bc2ae in term 1.
I20260807 10:48:08.357300 6369 leader_election.cc:302] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9702899228a642ca848abf498d9d4c33, b02765edca4a4e549670ba9b2d6b95cc, fdd60046a60a4bc981a7f1b4d33bc2ae; no voters:
I20260807 10:48:08.357719 6779 raft_consensus.cc:2781] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:08.358203 6779 raft_consensus.cc:686] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 1 LEADER]: Becoming Leader. State: Replica: fdd60046a60a4bc981a7f1b4d33bc2ae, State: Running, Role: LEADER
I20260807 10:48:08.358788 6779 consensus_queue.cc:237] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 } } peers { permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 } } peers { permanent_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38529 } }
I20260807 10:48:08.364168 6046 catalog_manager.cc:5495] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae reported cstate change: term changed from 0 to 1, leader changed from <none> to fdd60046a60a4bc981a7f1b4d33bc2ae (127.11.46.130). New cstate: current_term: 1 leader_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdd60046a60a4bc981a7f1b4d33bc2ae" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 38529 } health_report { overall_health: HEALTHY } } }
I20260807 10:48:08.488803 6798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:08.482530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58118 (local address 127.11.46.130:38529)
0807 10:48:08.483073 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:08.483078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:08.483228 (+ 150us) server_negotiation.cc:407] Connection header received
0807 10:48:08.483432 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:08.483436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:08.483544 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:08.483732 (+ 188us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:48:08.484165 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.484885 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.486451 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.486936 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.487053 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:08.487662 (+ 609us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:48:08.488249 (+ 587us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:48:08.488408 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:08.488497 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 10:48:08.488552 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":279,"threads_started":1}
I20260807 10:48:08.498732 6270 raft_consensus.cc:1261] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33 [term 1 FOLLOWER]: Refusing update from remote peer fdd60046a60a4bc981a7f1b4d33bc2ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:48:08.498732 6674 raft_consensus.cc:1261] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc [term 1 FOLLOWER]: Refusing update from remote peer fdd60046a60a4bc981a7f1b4d33bc2ae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:48:08.499951 6789 consensus_queue.cc:1035] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02765edca4a4e549670ba9b2d6b95cc" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 44433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:48:08.500365 6779 consensus_queue.cc:1035] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "9702899228a642ca848abf498d9d4c33" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 46525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:48:08.516172 6803 mvcc.cc:205] Tried to move back new op lower bound from 7315864324077486080 to 7315864323521953792. Current Snapshot: MvccSnapshot[applied={T|T < 7315864324077486080}]
I20260807 10:48:08.531615 6046 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44186:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:48:08.531983 6046 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44186:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:48:08.536506 6046 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 792f98c914e64207b6734633d36830ac: Sending DeleteTablet for 3 replicas of tablet 0a1ce2829fb442588b3c4e70548e22f4
I20260807 10:48:08.538085 6643 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a1ce2829fb442588b3c4e70548e22f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:08 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:52138
I20260807 10:48:08.538453 6434 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a1ce2829fb442588b3c4e70548e22f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:08 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:58114
I20260807 10:48:08.539000 6243 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a1ce2829fb442588b3c4e70548e22f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:08 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:34014
I20260807 10:48:08.539500 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 6151
I20260807 10:48:08.553773 6818 tablet_replica.cc:330] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: stopping tablet replica
I20260807 10:48:08.555716 6818 raft_consensus.cc:2229] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:48:08.556612 6818 raft_consensus.cc:2258] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:08.559571 6816 tablet_replica.cc:330] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: stopping tablet replica
I20260807 10:48:08.560155 6818 ts_tablet_manager.cc:1905] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:08.563908 6816 raft_consensus.cc:2229] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:48:08.564599 6816 raft_consensus.cc:2258] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:08.568620 6818 ts_tablet_manager.cc:1918] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:48:08.568950 6818 log.cc:1196] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/0a1ce2829fb442588b3c4e70548e22f4
I20260807 10:48:08.569020 6816 ts_tablet_manager.cc:1905] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:08.570001 6818 ts_tablet_manager.cc:1939] T 0a1ce2829fb442588b3c4e70548e22f4 P 9702899228a642ca848abf498d9d4c33: Deleting consensus metadata
Aug 07 10:48:08 dist-test-slave-42z9 krb5kdc[5983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:48:08.572952 6024 catalog_manager.cc:4841] TS 9702899228a642ca848abf498d9d4c33 (127.11.46.129:46525): tablet 0a1ce2829fb442588b3c4e70548e22f4 (table test-table [id=9eb3f68666744d69a62577d72c518e72]) successfully deleted
I20260807 10:48:08.574184 6817 tablet_replica.cc:330] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: stopping tablet replica
I20260807 10:48:08.574829 6817 raft_consensus.cc:2229] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:48:08.575821 6817 raft_consensus.cc:2258] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:08.578426 6817 ts_tablet_manager.cc:1905] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:08.581218 6816 ts_tablet_manager.cc:1918] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:48:08.581636 6816 log.cc:1196] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/0a1ce2829fb442588b3c4e70548e22f4
I20260807 10:48:08.582302 6816 ts_tablet_manager.cc:1939] T 0a1ce2829fb442588b3c4e70548e22f4 P b02765edca4a4e549670ba9b2d6b95cc: Deleting consensus metadata
I20260807 10:48:08.584431 6764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:08.540985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34026 (local address 127.11.46.129:46525)
0807 10:48:08.541208 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:08.541214 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:08.554677 (+ 13463us) server_negotiation.cc:407] Connection header received
0807 10:48:08.554895 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:08.554902 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:08.555008 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:08.555131 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:08.560009 (+ 4878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.561078 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.565306 (+ 4228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.566099 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.566235 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:08.575443 (+ 9208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:08.575467 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:08.575488 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:08.575549 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:08.579860 (+ 4311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:08.581097 (+ 1237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:08.581111 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:08.581114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:08.581349 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:08.582025 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:08.582032 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:08.582035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:08.582649 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:08.582979 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:08.583724 (+ 745us) server_negotiation.cc:299] Negotiation successful
0807 10:48:08.584016 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 10:48:08.584650 6029 catalog_manager.cc:4841] TS b02765edca4a4e549670ba9b2d6b95cc (127.11.46.131:44433): tablet 0a1ce2829fb442588b3c4e70548e22f4 (table test-table [id=9eb3f68666744d69a62577d72c518e72]) successfully deleted
I20260807 10:48:08.586514 6332 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:08.586789 6817 ts_tablet_manager.cc:1918] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:48:08.587102 6817 log.cc:1196] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/0a1ce2829fb442588b3c4e70548e22f4
I20260807 10:48:08.587929 6817 ts_tablet_manager.cc:1939] T 0a1ce2829fb442588b3c4e70548e22f4 P fdd60046a60a4bc981a7f1b4d33bc2ae: Deleting consensus metadata
I20260807 10:48:08.590736 6028 catalog_manager.cc:4841] TS fdd60046a60a4bc981a7f1b4d33bc2ae (127.11.46.130:38529): tablet 0a1ce2829fb442588b3c4e70548e22f4 (table test-table [id=9eb3f68666744d69a62577d72c518e72]) successfully deleted
I20260807 10:48:08.703577 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 6151
I20260807 10:48:08.738202 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 6348
Aug 07 10:48:08 dist-test-slave-42z9 krb5kdc[5983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:48:08.756775 6798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:08.739040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58122 (local address 127.11.46.130:38529)
0807 10:48:08.739225 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:08.739232 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:08.739311 (+ 79us) server_negotiation.cc:407] Connection header received
0807 10:48:08.739524 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:08.739530 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:08.739611 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:08.739701 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:08.741048 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.741942 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.743410 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.743904 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.744061 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:08.750269 (+ 6208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:08.750292 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:08.750313 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:08.750368 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:08.753596 (+ 3228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:08.754550 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:08.754556 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:08.754562 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:08.754716 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:08.755151 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:08.755155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:08.755157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:08.755574 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:08.755840 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:08.756177 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 10:48:08.756431 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:48:08.757757 6523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:08.895222 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 6348
I20260807 10:48:08.926796 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 6545
Aug 07 10:48:08 dist-test-slave-42z9 krb5kdc[5983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:48:08.944974 6822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:08.927615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52146 (local address 127.11.46.131:44433)
0807 10:48:08.928154 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:08.928159 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:08.928175 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:48:08.928235 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:08.928239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:08.928312 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:08.928417 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:08.930012 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.930837 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.932225 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:08.932667 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:08.932809 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:08.938370 (+ 5561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:08.938395 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:08.938416 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:08.938477 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:08.941597 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:08.942526 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:08.942533 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:08.942535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:08.942732 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:08.943262 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:08.943268 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:08.943270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:08.943788 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:08.944062 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:08.944369 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 10:48:08.944601 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":252,"threads_started":1}
I20260807 10:48:08.945815 6737 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:09.040506 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 6545
I20260807 10:48:09.068568 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 5998
I20260807 10:48:09.069926 6094 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:09.188091 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 5998
2026-08-07T10:48:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5515 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T10:48:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:09Z Disabled control of system clock
I20260807 10:48:09.311308 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35261
--webserver_interface=127.11.46.190
--webserver_port=0
--builtin_ntp_servers=127.11.46.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:35261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:48:09.710351 6830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:09.710696 6830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:09.710783 6830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:09.718546 6830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:09.718695 6830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:09.718735 6830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:09.718788 6830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:09.718843 6830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:09.728916 6830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:35261
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:09.730427 6830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:09.732477 6830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:09.745477 6839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:09.746065 6838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:09.745708 6842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:09.747243 6830 server_base.cc:1034] running on GCE node
I20260807 10:48:09.748241 6830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:09.749989 6830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:09.751233 6830 hybrid_clock.cc:648] HybridClock initialized: now 1786099689751171 us; error 58 us; skew 500 ppm
I20260807 10:48:09.751647 6830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:09.754496 6830 webserver.cc:460] Webserver started at http://127.11.46.190:36567/ using document root <none> and password file <none>
I20260807 10:48:09.755498 6830 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:09.755633 6830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:09.755995 6830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:09.759568 6830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "69dfeec7666844c19693deb4ef8056ad"
format_stamp: "Formatted at 2026-08-07 10:48:09 on dist-test-slave-42z9"
server_key: "e4cbb3b32c9a48e2f1803d2ae3f58246"
server_key_iv: "ac4be7f6aaac2f88238ff99f4223b84d"
server_key_version: "encryptionkey@0"
I20260807 10:48:09.760545 6830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "69dfeec7666844c19693deb4ef8056ad"
format_stamp: "Formatted at 2026-08-07 10:48:09 on dist-test-slave-42z9"
server_key: "e4cbb3b32c9a48e2f1803d2ae3f58246"
server_key_iv: "ac4be7f6aaac2f88238ff99f4223b84d"
server_key_version: "encryptionkey@0"
I20260807 10:48:09.767009 6830 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:48:09.771512 6850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:09.773198 6830 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260807 10:48:09.773487 6830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "69dfeec7666844c19693deb4ef8056ad"
format_stamp: "Formatted at 2026-08-07 10:48:09 on dist-test-slave-42z9"
server_key: "e4cbb3b32c9a48e2f1803d2ae3f58246"
server_key_iv: "ac4be7f6aaac2f88238ff99f4223b84d"
server_key_version: "encryptionkey@0"
I20260807 10:48:09.773782 6830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:09.796514 6830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:09.797741 6830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:09.798079 6830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:09.819721 6830 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:35261
I20260807 10:48:09.819748 6925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:35261 every 8 connection(s)
I20260807 10:48:09.821293 6830 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:09.826022 6926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:09.827061 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 6830
I20260807 10:48:09.827270 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:09.827888 11450 external_mini_cluster.cc:1428] Setting key cee1999906b062c8dbaa1700c9dfa86c
I20260807 10:48:09.842397 6926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad: Bootstrap starting.
I20260807 10:48:09.844210 6930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:09.830286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54630 (local address 127.11.46.190:35261)
0807 10:48:09.831484 (+ 1198us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:09.831496 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:09.831551 (+ 55us) server_negotiation.cc:407] Connection header received
0807 10:48:09.833431 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:09.833509 (+ 78us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:09.834162 (+ 653us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:09.834591 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:09.835282 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:09.836712 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:09.838857 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:09.839778 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:09.839947 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:09.841421 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:09.841430 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:09.841497 (+ 67us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:09.842148 (+ 651us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:09.842244 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:09.842269 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:09.842381 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:09.842684 (+ 303us) server_negotiation.cc:299] Negotiation successful
0807 10:48:09.843087 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":438,"threads_started":1}
I20260807 10:48:09.846666 6926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:09.848140 6926 log.cc:824] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:09.851770 6926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad: No bootstrap required, opened a new log
I20260807 10:48:09.860690 6926 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69dfeec7666844c19693deb4ef8056ad" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35261 } }
I20260807 10:48:09.861212 6926 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:09.861318 6926 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69dfeec7666844c19693deb4ef8056ad, State: Initialized, Role: FOLLOWER
I20260807 10:48:09.861960 6926 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69dfeec7666844c19693deb4ef8056ad" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35261 } }
I20260807 10:48:09.862289 6926 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:09.862461 6926 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:09.862679 6926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:09.865334 6926 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69dfeec7666844c19693deb4ef8056ad" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35261 } }
I20260807 10:48:09.866087 6926 leader_election.cc:302] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69dfeec7666844c19693deb4ef8056ad; no voters:
I20260807 10:48:09.866762 6926 leader_election.cc:288] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:09.866936 6933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:09.867741 6933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [term 1 LEADER]: Becoming Leader. State: Replica: 69dfeec7666844c19693deb4ef8056ad, State: Running, Role: LEADER
I20260807 10:48:09.868516 6933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69dfeec7666844c19693deb4ef8056ad" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35261 } }
I20260807 10:48:09.869278 6926 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:09.871953 6934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69dfeec7666844c19693deb4ef8056ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69dfeec7666844c19693deb4ef8056ad" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35261 } } }
I20260807 10:48:09.872464 6935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69dfeec7666844c19693deb4ef8056ad. Latest consensus state: current_term: 1 leader_uuid: "69dfeec7666844c19693deb4ef8056ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69dfeec7666844c19693deb4ef8056ad" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35261 } } }
I20260807 10:48:09.872828 6934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:09.872823 6935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:09.875085 6943 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:09.880728 6943 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:09.891386 6943 catalog_manager.cc:1347] Generated new cluster ID: 1d1ad09384f84129b6c25a135b5cfd5b
I20260807 10:48:09.891554 6943 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:09.906816 6943 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:09.908265 6943 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:09.926023 6943 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad: Generated new TSK 0
I20260807 10:48:09.927071 6943 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:09.932894 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35261
--builtin_ntp_servers=127.11.46.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:48:10.341522 6960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:10.341910 6960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:10.342063 6960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:10.350116 6960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:10.350242 6960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:10.350395 6960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:48:10.360628 6960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35261
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:10.362231 6960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:10.364308 6960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:10.380308 6966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:10.380185 6970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:10.380255 6967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:10.381333 6960 server_base.cc:1034] running on GCE node
I20260807 10:48:10.382272 6960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:10.383754 6960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:10.384984 6960 hybrid_clock.cc:648] HybridClock initialized: now 1786099690384916 us; error 57 us; skew 500 ppm
I20260807 10:48:10.385398 6960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:10.388152 6960 webserver.cc:460] Webserver started at http://127.11.46.129:39831/ using document root <none> and password file <none>
I20260807 10:48:10.388964 6960 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:10.389071 6960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:10.389390 6960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:10.392920 6960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "f9c49d5d1a6a4a2796561864b13cbee4"
format_stamp: "Formatted at 2026-08-07 10:48:10 on dist-test-slave-42z9"
server_key: "4105b5de9e255d7f598b41e4b3746b1c"
server_key_iv: "10d7a9617f9b5d97693d1674a780db37"
server_key_version: "encryptionkey@0"
I20260807 10:48:10.393909 6960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "f9c49d5d1a6a4a2796561864b13cbee4"
format_stamp: "Formatted at 2026-08-07 10:48:10 on dist-test-slave-42z9"
server_key: "4105b5de9e255d7f598b41e4b3746b1c"
server_key_iv: "10d7a9617f9b5d97693d1674a780db37"
server_key_version: "encryptionkey@0"
I20260807 10:48:10.400274 6960 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:48:10.404536 6976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:10.406322 6960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:48:10.406527 6960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "f9c49d5d1a6a4a2796561864b13cbee4"
format_stamp: "Formatted at 2026-08-07 10:48:10 on dist-test-slave-42z9"
server_key: "4105b5de9e255d7f598b41e4b3746b1c"
server_key_iv: "10d7a9617f9b5d97693d1674a780db37"
server_key_version: "encryptionkey@0"
I20260807 10:48:10.406771 6960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:10.447335 6960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:10.448321 6960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:10.448632 6960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:10.449851 6960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:10.451666 6960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:10.451766 6960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:10.451884 6960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:10.451958 6960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:10.487859 6960 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:39355
I20260807 10:48:10.487989 7131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:39355 every 8 connection(s)
I20260807 10:48:10.489377 6960 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:48:10.498422 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 6960
I20260807 10:48:10.498610 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:48:10.499097 11450 external_mini_cluster.cc:1428] Setting key 6b2f9ff4b40f775573a16bce995e4136
I20260807 10:48:10.502274 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35261
--builtin_ntp_servers=127.11.46.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:48:10.504220 7136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:10.492382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:58661 (local address 127.11.46.190:35261)
0807 10:48:10.492910 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:10.492915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:10.494253 (+ 1338us) server_negotiation.cc:407] Connection header received
0807 10:48:10.496288 (+ 2035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:10.496295 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:10.496417 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:10.496524 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:10.497944 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:10.498854 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:10.500916 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:10.501528 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:10.501663 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:10.503258 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:10.503263 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:10.503267 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:10.503288 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:10.503335 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:10.503348 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:10.503433 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:10.503692 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 10:48:10.503817 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":273,"threads_started":1}
I20260807 10:48:10.505501 7137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:10.492949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35261 (local address 127.11.46.129:58661)
0807 10:48:10.494070 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:10.494111 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:10.495919 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:10.496833 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:10.496843 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:10.496962 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:10.497703 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:10.497728 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:10.499072 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:10.499077 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:10.500733 (+ 1656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:10.500753 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:10.501802 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:10.501811 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:10.502097 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:10.502854 (+ 757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:48:10.502858 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:10.502916 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:48:10.503026 (+ 110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:10.503460 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:10.503472 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:10.503480 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 10:48:10.503665 (+ 185us) client_negotiation.cc:240] Negotiation successful
0807 10:48:10.504203 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":371,"threads_started":1}
I20260807 10:48:10.507465 7132 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35261
I20260807 10:48:10.507869 7132 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:10.508797 7132 heartbeater.cc:511] Master 127.11.46.190:35261 requested a full tablet report, sending...
I20260807 10:48:10.511807 6871 ts_manager.cc:194] Registered new tserver with Master: f9c49d5d1a6a4a2796561864b13cbee4 (127.11.46.129:39355)
I20260807 10:48:10.514034 6871 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.129:58661
W20260807 10:48:10.917804 7140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:10.918141 7140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:10.918280 7140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:10.926326 7140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:10.926455 7140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:10.926614 7140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:48:10.936998 7140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35261
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:10.938627 7140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:10.940830 7140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:10.956187 7146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:10.956229 7149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:10.956143 7145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:10.957432 7140 server_base.cc:1034] running on GCE node
I20260807 10:48:10.958269 7140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:10.959437 7140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:10.960682 7140 hybrid_clock.cc:648] HybridClock initialized: now 1786099690960616 us; error 56 us; skew 500 ppm
I20260807 10:48:10.961081 7140 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:10.966521 7140 webserver.cc:460] Webserver started at http://127.11.46.130:41641/ using document root <none> and password file <none>
I20260807 10:48:10.967437 7140 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:10.967585 7140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:10.967960 7140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:10.971513 7140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "d947f53631d94553953f5b019ca9e85e"
format_stamp: "Formatted at 2026-08-07 10:48:10 on dist-test-slave-42z9"
server_key: "d21adf7c067d6a12a70e6a00795b367e"
server_key_iv: "a4e6322b19fabe9a2fbf0c89d4e6f067"
server_key_version: "encryptionkey@0"
I20260807 10:48:10.972448 7140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "d947f53631d94553953f5b019ca9e85e"
format_stamp: "Formatted at 2026-08-07 10:48:10 on dist-test-slave-42z9"
server_key: "d21adf7c067d6a12a70e6a00795b367e"
server_key_iv: "a4e6322b19fabe9a2fbf0c89d4e6f067"
server_key_version: "encryptionkey@0"
I20260807 10:48:10.979102 7140 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260807 10:48:10.983583 7158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:10.985150 7140 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 10:48:10.985355 7140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "d947f53631d94553953f5b019ca9e85e"
format_stamp: "Formatted at 2026-08-07 10:48:10 on dist-test-slave-42z9"
server_key: "d21adf7c067d6a12a70e6a00795b367e"
server_key_iv: "a4e6322b19fabe9a2fbf0c89d4e6f067"
server_key_version: "encryptionkey@0"
I20260807 10:48:10.985668 7140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:11.014497 7140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:11.015530 7140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:11.015864 7140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:11.017009 7140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:11.018833 7140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:11.018951 7140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:11.019080 7140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:11.019156 7140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:11.053594 7140 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:36537
I20260807 10:48:11.053654 7307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:36537 every 8 connection(s)
I20260807 10:48:11.055003 7140 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:48:11.056353 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 7140
I20260807 10:48:11.056550 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:48:11.057123 11450 external_mini_cluster.cc:1428] Setting key f830f5562c5740388d24402a53711c54
I20260807 10:48:11.060549 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35261
--builtin_ntp_servers=127.11.46.148:35093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:48:11.069648 7312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.058291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:45103 (local address 127.11.46.190:35261)
0807 10:48:11.058819 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.058825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.059981 (+ 1156us) server_negotiation.cc:407] Connection header received
0807 10:48:11.061980 (+ 1999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.061985 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.062086 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.062187 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:11.063397 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.064160 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.065844 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.066275 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.066394 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.068484 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:11.068491 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:11.068494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:11.068530 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:11.068582 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:11.068597 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:11.068722 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.069079 (+ 357us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.069205 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":254,"threads_started":1}
I20260807 10:48:11.071115 7313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.058620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35261 (local address 127.11.46.130:45103)
0807 10:48:11.059820 (+ 1200us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.059867 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.061698 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.062460 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.062469 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.062568 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:11.063201 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.063226 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.064334 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.064338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.065685 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.065701 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.066533 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.066542 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.066783 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.067683 (+ 900us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:48:11.067688 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:11.067776 (+ 88us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:48:11.067936 (+ 160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:11.068783 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:11.068798 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:11.068807 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.069043 (+ 236us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.069615 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":345,"threads_started":1}
I20260807 10:48:11.072978 7309 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35261
I20260807 10:48:11.073356 7309 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:11.074458 7309 heartbeater.cc:511] Master 127.11.46.190:35261 requested a full tablet report, sending...
I20260807 10:48:11.076473 6871 ts_manager.cc:194] Registered new tserver with Master: d947f53631d94553953f5b019ca9e85e (127.11.46.130:36537)
I20260807 10:48:11.077603 6871 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.130:45103
W20260807 10:48:11.459631 7314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:11.459978 7314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:11.460078 7314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:11.467983 7314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:11.468129 7314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:11.468247 7314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:48:11.478796 7314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:35261
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:11.480350 7314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:11.482815 7314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:11.499073 7320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:11.499146 7325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:11.499172 7321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:11.500139 7314 server_base.cc:1034] running on GCE node
I20260807 10:48:11.500896 7314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:11.502116 7314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:11.503373 7314 hybrid_clock.cc:648] HybridClock initialized: now 1786099691503312 us; error 52 us; skew 500 ppm
I20260807 10:48:11.503822 7314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:11.506492 7314 webserver.cc:460] Webserver started at http://127.11.46.131:38437/ using document root <none> and password file <none>
I20260807 10:48:11.507292 7314 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:11.507438 7314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:11.507797 7314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:11.511179 7314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "dffe7b34510943fdab653decdcc18203"
format_stamp: "Formatted at 2026-08-07 10:48:11 on dist-test-slave-42z9"
server_key: "5c074ffca25e941865db97aa291a4ea5"
server_key_iv: "9c96c1bbf0982b52db74600175501336"
server_key_version: "encryptionkey@0"
I20260807 10:48:11.512212 7314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "dffe7b34510943fdab653decdcc18203"
format_stamp: "Formatted at 2026-08-07 10:48:11 on dist-test-slave-42z9"
server_key: "5c074ffca25e941865db97aa291a4ea5"
server_key_iv: "9c96c1bbf0982b52db74600175501336"
server_key_version: "encryptionkey@0"
I20260807 10:48:11.518307 7132 heartbeater.cc:503] Master 127.11.46.190:35261 was elected leader, sending a full tablet report...
I20260807 10:48:11.518844 7314 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260807 10:48:11.523677 7332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:11.525332 7314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:48:11.525607 7314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "dffe7b34510943fdab653decdcc18203"
format_stamp: "Formatted at 2026-08-07 10:48:11 on dist-test-slave-42z9"
server_key: "5c074ffca25e941865db97aa291a4ea5"
server_key_iv: "9c96c1bbf0982b52db74600175501336"
server_key_version: "encryptionkey@0"
I20260807 10:48:11.525867 7314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:11.547083 7314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:11.548095 7314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:11.548439 7314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:11.549619 7314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:11.551384 7314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:11.551508 7314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:11.551627 7314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:11.551700 7314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:11.586299 7314 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:43819
I20260807 10:48:11.586318 7490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:43819 every 8 connection(s)
I20260807 10:48:11.587837 7314 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:48:11.595778 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 7314
I20260807 10:48:11.595973 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:48:11.596570 11450 external_mini_cluster.cc:1428] Setting key 762d65d68874be324ff1bd800330648f
I20260807 10:48:11.602241 7495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.590813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:58145 (local address 127.11.46.190:35261)
0807 10:48:11.591315 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.591320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.592719 (+ 1399us) server_negotiation.cc:407] Connection header received
0807 10:48:11.594760 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.594764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.594855 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.594954 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:11.596206 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.597253 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.599052 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.599551 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.599680 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.601250 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:11.601255 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:11.601259 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:11.601279 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:11.601322 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:11.601334 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:11.601424 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.601707 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.601828 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":262,"threads_started":1}
I20260807 10:48:11.603420 7496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.591509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:35261 (local address 127.11.46.131:58145)
0807 10:48:11.592512 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.592558 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.594453 (+ 1895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.595168 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.595177 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.595276 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:11.595960 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.595990 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.597479 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.597485 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.598881 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.598898 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.599828 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.599846 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.600115 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.600869 (+ 754us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:48:11.600871 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:11.600923 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:48:11.601028 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:11.601472 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:11.601486 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:11.601493 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.601682 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.602192 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":310,"threads_started":1}
I20260807 10:48:11.604851 7492 heartbeater.cc:347] Connected to a master server at 127.11.46.190:35261
I20260807 10:48:11.605214 7492 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:11.606120 7492 heartbeater.cc:511] Master 127.11.46.190:35261 requested a full tablet report, sending...
I20260807 10:48:11.607843 6871 ts_manager.cc:194] Registered new tserver with Master: dffe7b34510943fdab653decdcc18203 (127.11.46.131:43819)
I20260807 10:48:11.608717 6871 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.131:58145
I20260807 10:48:11.612980 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:48:11.624078 7495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.617794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54642 (local address 127.11.46.190:35261)
0807 10:48:11.618017 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.618024 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.618358 (+ 334us) server_negotiation.cc:407] Connection header received
0807 10:48:11.618542 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.618546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.618616 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.618704 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:11.619256 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.620043 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.621520 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.621954 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.622075 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.623301 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:11.623307 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:11.623310 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:11.623332 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:11.623367 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:11.623379 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:11.623513 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.623710 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.623789 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:48:11.628698 6871 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:48:11.636119 6871 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:48:11.661682 7513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.650054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:36537 (local address 127.0.0.1:41964)
0807 10:48:11.650964 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.651010 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.651218 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.654067 (+ 2849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.654072 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.654101 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:11.654541 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.654560 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.656755 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.656760 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.658379 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.658397 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.660620 (+ 2223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.660628 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.660847 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.660920 (+ 73us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.661044 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.661268 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":883,"threads_started":1}
I20260807 10:48:11.662582 7515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.650423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:43819 (local address 127.0.0.1:45540)
0807 10:48:11.651805 (+ 1382us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.651823 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.651938 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.653359 (+ 1421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.653367 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.653404 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:11.653902 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.653920 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.656221 (+ 2301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.656226 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.658628 (+ 2402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.658648 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.661832 (+ 3184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.661840 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.662017 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.662050 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.662123 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.662266 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1259,"thread_start_us":1117,"threads_started":1}
I20260807 10:48:11.662691 7514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.650222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41964 (local address 127.11.46.130:36537)
0807 10:48:11.653523 (+ 3301us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.653531 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.653558 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:48:11.653649 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.653654 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.653828 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.654791 (+ 963us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:11.655091 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.656575 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.658627 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.660332 (+ 1705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.661659 (+ 1327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.661993 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.662096 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.662309 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3107,"thread_start_us":2997,"threads_started":1}
I20260807 10:48:11.663417 7518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.654067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.0.0.1:53764)
0807 10:48:11.654788 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.654805 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.655027 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.655990 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.655995 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.656022 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:11.656470 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.656482 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.658462 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.658467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.660515 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.660530 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.662603 (+ 2073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.662611 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.662803 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.662840 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.662944 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.663087 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":1,"thread_start_us":446,"threads_started":1}
I20260807 10:48:11.663584 7517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.653669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53764 (local address 127.11.46.129:39355)
0807 10:48:11.654352 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.654361 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.654910 (+ 549us) server_negotiation.cc:407] Connection header received
0807 10:48:11.655251 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.655260 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.655511 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.655690 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:11.656691 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.658289 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.660793 (+ 2504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.662033 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.662174 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.662451 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.663021 (+ 570us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.663214 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":564,"threads_started":1}
I20260807 10:48:11.663923 7516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.650634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45540 (local address 127.11.46.131:43819)
0807 10:48:11.652563 (+ 1929us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.652573 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.652615 (+ 42us) server_negotiation.cc:407] Connection header received
0807 10:48:11.652811 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.652819 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.653089 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.654164 (+ 1075us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:11.654506 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.656037 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.658903 (+ 2866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.661588 (+ 2685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.662990 (+ 1402us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.663280 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.663359 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.663557 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1716,"thread_start_us":1554,"threads_started":1}
I20260807 10:48:11.667717 7395 tablet_service.cc:1467] Processing CreateTablet for tablet abf6f547291142afb56d5177a16982af (DEFAULT_TABLE table=test-table [id=483e84d23dd34c5b9f28bbb388694d4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:11.667553 7219 tablet_service.cc:1467] Processing CreateTablet for tablet abf6f547291142afb56d5177a16982af (DEFAULT_TABLE table=test-table [id=483e84d23dd34c5b9f28bbb388694d4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:11.667552 7042 tablet_service.cc:1467] Processing CreateTablet for tablet abf6f547291142afb56d5177a16982af (DEFAULT_TABLE table=test-table [id=483e84d23dd34c5b9f28bbb388694d4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:11.669152 7395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abf6f547291142afb56d5177a16982af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:11.669246 7219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abf6f547291142afb56d5177a16982af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:11.669237 7042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abf6f547291142afb56d5177a16982af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:11.682931 7519 tablet_bootstrap.cc:492] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: Bootstrap starting.
I20260807 10:48:11.686259 7523 tablet_bootstrap.cc:492] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: Bootstrap starting.
I20260807 10:48:11.687199 7521 tablet_bootstrap.cc:492] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4: Bootstrap starting.
I20260807 10:48:11.688345 7519 tablet_bootstrap.cc:654] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:11.689987 7519 log.cc:824] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:11.691043 7523 tablet_bootstrap.cc:654] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:11.691172 7521 tablet_bootstrap.cc:654] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:11.692370 7523 log.cc:824] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:11.692453 7521 log.cc:824] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:11.694340 7519 tablet_bootstrap.cc:492] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: No bootstrap required, opened a new log
I20260807 10:48:11.694810 7519 ts_tablet_manager.cc:1397] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260807 10:48:11.696484 7523 tablet_bootstrap.cc:492] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: No bootstrap required, opened a new log
I20260807 10:48:11.696828 7523 ts_tablet_manager.cc:1397] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260807 10:48:11.697880 7521 tablet_bootstrap.cc:492] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4: No bootstrap required, opened a new log
I20260807 10:48:11.698222 7521 ts_tablet_manager.cc:1397] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260807 10:48:11.703334 7519 raft_consensus.cc:348] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.703807 7519 raft_consensus.cc:374] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:11.703931 7519 raft_consensus.cc:729] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dffe7b34510943fdab653decdcc18203, State: Initialized, Role: FOLLOWER
I20260807 10:48:11.704707 7519 consensus_queue.cc:260] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.707319 7492 heartbeater.cc:503] Master 127.11.46.190:35261 was elected leader, sending a full tablet report...
I20260807 10:48:11.708321 7523 raft_consensus.cc:348] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.708896 7523 raft_consensus.cc:374] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:11.709110 7523 raft_consensus.cc:729] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d947f53631d94553953f5b019ca9e85e, State: Initialized, Role: FOLLOWER
I20260807 10:48:11.709218 7521 raft_consensus.cc:348] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.709656 7519 ts_tablet_manager.cc:1428] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: Time spent starting tablet: real 0.015s user 0.010s sys 0.003s
I20260807 10:48:11.709820 7521 raft_consensus.cc:374] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:11.709978 7521 raft_consensus.cc:729] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9c49d5d1a6a4a2796561864b13cbee4, State: Initialized, Role: FOLLOWER
I20260807 10:48:11.710037 7523 consensus_queue.cc:260] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.710588 7521 consensus_queue.cc:260] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.711359 7309 heartbeater.cc:503] Master 127.11.46.190:35261 was elected leader, sending a full tablet report...
I20260807 10:48:11.712375 7523 ts_tablet_manager.cc:1428] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: Time spent starting tablet: real 0.015s user 0.017s sys 0.000s
I20260807 10:48:11.714023 7521 ts_tablet_manager.cc:1428] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
W20260807 10:48:11.742223 7133 tablet.cc:2369] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:48:11.778774 7534 raft_consensus.cc:482] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:48:11.779147 7534 raft_consensus.cc:504] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.780196 7532 raft_consensus.cc:482] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:48:11.780498 7532 raft_consensus.cc:504] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.781610 7533 raft_consensus.cc:482] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:48:11.781937 7533 raft_consensus.cc:504] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.783980 7533 leader_election.cc:288] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dffe7b34510943fdab653decdcc18203 (127.11.46.131:43819), f9c49d5d1a6a4a2796561864b13cbee4 (127.11.46.129:39355)
I20260807 10:48:11.788364 7534 leader_election.cc:288] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d947f53631d94553953f5b019ca9e85e (127.11.46.130:36537), dffe7b34510943fdab653decdcc18203 (127.11.46.131:43819)
I20260807 10:48:11.789283 7532 leader_election.cc:288] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d947f53631d94553953f5b019ca9e85e (127.11.46.130:36537), f9c49d5d1a6a4a2796561864b13cbee4 (127.11.46.129:39355)
I20260807 10:48:11.799960 7539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.784299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:43819 (local address 127.11.46.130:52939)
0807 10:48:11.785780 (+ 1481us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.785807 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.785951 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.790593 (+ 4642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.790598 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.790634 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:11.791152 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.791168 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.794071 (+ 2903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.794078 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.796608 (+ 2530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.796625 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.798976 (+ 2351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.798984 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.799193 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.799235 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.799308 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.799501 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1343,"mutex_wait_us":6,"thread_start_us":1155,"threads_started":1}
I20260807 10:48:11.801354 7541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.784768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:52939 (local address 127.11.46.131:43819)
0807 10:48:11.790161 (+ 5393us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.790168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.790201 (+ 33us) server_negotiation.cc:407] Connection header received
0807 10:48:11.790291 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.790298 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.790387 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.791353 (+ 966us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:11.791661 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.793008 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.796867 (+ 3859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.798707 (+ 1840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.800613 (+ 1906us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.800693 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.800753 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.800903 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":354,"server-negotiator.queue_time_us":5233,"thread_start_us":5002,"threads_started":1}
I20260807 10:48:11.802032 7496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.782887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:36537 (local address 127.11.46.131:59365)
0807 10:48:11.783156 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.783177 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.783308 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.794552 (+ 11244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.794558 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.794589 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:11.794825 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.794837 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.796873 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.796878 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.799106 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.799122 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.801175 (+ 2053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.801181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.801407 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.801474 (+ 67us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.801556 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.801705 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":21}
I20260807 10:48:11.803627 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.783640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:59365 (local address 127.11.46.130:36537)
0807 10:48:11.794159 (+ 10519us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.794165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.794188 (+ 23us) server_negotiation.cc:407] Connection header received
0807 10:48:11.794255 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.794260 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.794350 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.795005 (+ 655us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:11.795314 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.796704 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.799304 (+ 2600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.800966 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.802898 (+ 1932us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.802982 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.803038 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.803186 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":141,"server-negotiator.queue_time_us":10361,"thread_start_us":10182,"threads_started":1}
I20260807 10:48:11.803671 7516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.781875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:45005 (local address 127.11.46.131:43819)
0807 10:48:11.782315 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.782322 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.795838 (+ 13516us) server_negotiation.cc:407] Connection header received
0807 10:48:11.796119 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.796124 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.796188 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.796242 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:11.797002 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.798331 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.801205 (+ 2874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.802471 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.802586 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.802649 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.803274 (+ 625us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.803412 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282}
I20260807 10:48:11.803696 7425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "d947f53631d94553953f5b019ca9e85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffe7b34510943fdab653decdcc18203" is_pre_election: true
I20260807 10:48:11.804426 7535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.782521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:43819 (local address 127.11.46.129:45005)
0807 10:48:11.795733 (+ 13212us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.795756 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.795960 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.796435 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.796445 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.796468 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:11.796788 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.796801 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.798500 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.798505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.800972 (+ 2467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.800991 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.802845 (+ 1854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.802853 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.803073 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.803109 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.803917 (+ 808us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.804089 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13089,"thread_start_us":12533,"threads_started":1}
I20260807 10:48:11.804342 7425 raft_consensus.cc:2454] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d947f53631d94553953f5b019ca9e85e in term 0.
I20260807 10:48:11.804781 7245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "dffe7b34510943fdab653decdcc18203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d947f53631d94553953f5b019ca9e85e" is_pre_election: true
I20260807 10:48:11.805274 7425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffe7b34510943fdab653decdcc18203" is_pre_election: true
I20260807 10:48:11.805346 7245 raft_consensus.cc:2454] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dffe7b34510943fdab653decdcc18203 in term 0.
I20260807 10:48:11.805662 7425 raft_consensus.cc:2454] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9c49d5d1a6a4a2796561864b13cbee4 in term 0.
I20260807 10:48:11.805372 7159 leader_election.cc:302] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d947f53631d94553953f5b019ca9e85e, dffe7b34510943fdab653decdcc18203; no voters:
I20260807 10:48:11.806325 6977 leader_election.cc:302] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dffe7b34510943fdab653decdcc18203, f9c49d5d1a6a4a2796561864b13cbee4; no voters:
I20260807 10:48:11.806614 7517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.795847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:35867 (local address 127.11.46.129:39355)
0807 10:48:11.796020 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.796025 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.796041 (+ 16us) server_negotiation.cc:407] Connection header received
0807 10:48:11.796093 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.796097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.796174 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.796251 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:11.797167 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.798287 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.801080 (+ 2793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.802326 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.802506 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.803765 (+ 1259us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.806208 (+ 2443us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.806357 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 10:48:11.806654 7533 raft_consensus.cc:2781] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:48:11.806792 7533 raft_consensus.cc:482] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:48:11.806830 7534 raft_consensus.cc:2781] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:48:11.806911 7533 raft_consensus.cc:3037] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:11.806982 7534 raft_consensus.cc:482] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:48:11.807092 7534 raft_consensus.cc:3037] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 0 FOLLOWER]: Advancing to term 1
W20260807 10:48:11.807080 7310 tablet.cc:2369] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:48:11.810678 7533 raft_consensus.cc:504] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.810701 7534 raft_consensus.cc:504] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.812698 7336 leader_election.cc:302] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d947f53631d94553953f5b019ca9e85e, dffe7b34510943fdab653decdcc18203; no voters:
I20260807 10:48:11.813297 7532 raft_consensus.cc:2781] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:48:11.813513 7532 raft_consensus.cc:482] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:48:11.813635 7532 raft_consensus.cc:3037] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:11.813984 7425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "d947f53631d94553953f5b019ca9e85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffe7b34510943fdab653decdcc18203"
I20260807 10:48:11.814244 7514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.781774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:58277 (local address 127.11.46.130:36537)
0807 10:48:11.782121 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.782128 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.795558 (+ 13430us) server_negotiation.cc:407] Connection header received
0807 10:48:11.802147 (+ 6589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.802152 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.802252 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.802312 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:11.803915 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.804957 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.811045 (+ 6088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.812311 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.812453 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.812530 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.813774 (+ 1244us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.813933 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260807 10:48:11.814345 7538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.784283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.11.46.130:35867)
0807 10:48:11.785001 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.785024 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.785183 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.796422 (+ 11239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.796427 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.796475 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:11.796987 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.797004 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.798494 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.798500 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.800826 (+ 2326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.800846 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.805542 (+ 4696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.805549 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.805735 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.805773 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.805870 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.806042 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":5,"thread_start_us":668,"threads_started":1}
I20260807 10:48:11.814714 7517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.797083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:39327 (local address 127.11.46.129:39355)
0807 10:48:11.806830 (+ 9747us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:11.806835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:11.806855 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:48:11.806915 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:11.806919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:11.807021 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:11.807779 (+ 758us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:11.807936 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.809136 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.811650 (+ 2514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.812899 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.814145 (+ 1246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.814217 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:11.814267 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 10:48:11.814409 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9628,"threads_started":1}
I20260807 10:48:11.814749 7533 leader_election.cc:288] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [CANDIDATE]: Term 1 election: Requested vote from peers dffe7b34510943fdab653decdcc18203 (127.11.46.131:43819), f9c49d5d1a6a4a2796561864b13cbee4 (127.11.46.129:39355)
I20260807 10:48:11.814008 7544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.789732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.11.46.131:39327)
0807 10:48:11.793813 (+ 4081us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.793840 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.794021 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.807208 (+ 13187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.807214 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.807247 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:11.807612 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.807628 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.809334 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.809340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.811367 (+ 2027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.811390 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.813164 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.813172 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.813360 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.813397 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.813502 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.813667 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3907,"thread_start_us":3713,"threads_started":1}
I20260807 10:48:11.815327 7536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:11.781981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:36537 (local address 127.11.46.129:58277)
0807 10:48:11.795421 (+ 13440us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:11.795455 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:11.801765 (+ 6310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:11.802536 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:11.802540 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:11.802572 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:11.803055 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.803068 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.805187 (+ 2119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.805193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.810139 (+ 4946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:11.810159 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:11.812837 (+ 2678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:11.812845 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:11.813028 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:11.813067 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 10:48:11.814475 (+ 1408us) client_negotiation.cc:240] Negotiation successful
0807 10:48:11.814638 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13285,"thread_start_us":13599,"threads_started":1}
I20260807 10:48:11.816185 7534 leader_election.cc:288] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [CANDIDATE]: Term 1 election: Requested vote from peers d947f53631d94553953f5b019ca9e85e (127.11.46.130:36537), dffe7b34510943fdab653decdcc18203 (127.11.46.131:43819)
I20260807 10:48:11.816244 7245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d947f53631d94553953f5b019ca9e85e" is_pre_election: true
I20260807 10:48:11.816591 7245 raft_consensus.cc:2379] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9c49d5d1a6a4a2796561864b13cbee4 in current term 1: Already voted for candidate d947f53631d94553953f5b019ca9e85e in this term.
I20260807 10:48:11.816789 7068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "dffe7b34510943fdab653decdcc18203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" is_pre_election: true
I20260807 10:48:11.817329 7068 raft_consensus.cc:2379] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dffe7b34510943fdab653decdcc18203 in current term 1: Already voted for candidate f9c49d5d1a6a4a2796561864b13cbee4 in this term.
I20260807 10:48:11.817266 7423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffe7b34510943fdab653decdcc18203"
I20260807 10:48:11.818015 7067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "d947f53631d94553953f5b019ca9e85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" is_pre_election: true
I20260807 10:48:11.818315 7068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "d947f53631d94553953f5b019ca9e85e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9c49d5d1a6a4a2796561864b13cbee4"
I20260807 10:48:11.818504 7067 raft_consensus.cc:2379] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d947f53631d94553953f5b019ca9e85e in current term 1: Already voted for candidate f9c49d5d1a6a4a2796561864b13cbee4 in this term.
I20260807 10:48:11.818596 7245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d947f53631d94553953f5b019ca9e85e"
I20260807 10:48:11.818879 7245 raft_consensus.cc:2379] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f9c49d5d1a6a4a2796561864b13cbee4 in current term 1: Already voted for candidate d947f53631d94553953f5b019ca9e85e in this term.
I20260807 10:48:11.819003 7532 raft_consensus.cc:504] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:11.819584 7425 raft_consensus.cc:2379] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d947f53631d94553953f5b019ca9e85e in current term 1: Already voted for candidate dffe7b34510943fdab653decdcc18203 in this term.
I20260807 10:48:11.819885 7532 leader_election.cc:288] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [CANDIDATE]: Term 1 election: Requested vote from peers d947f53631d94553953f5b019ca9e85e (127.11.46.130:36537), f9c49d5d1a6a4a2796561864b13cbee4 (127.11.46.129:39355)
I20260807 10:48:11.820312 6982 leader_election.cc:302] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9c49d5d1a6a4a2796561864b13cbee4; no voters: d947f53631d94553953f5b019ca9e85e, dffe7b34510943fdab653decdcc18203
I20260807 10:48:11.820612 7534 raft_consensus.cc:2726] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 10:48:11.820693 7245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "dffe7b34510943fdab653decdcc18203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d947f53631d94553953f5b019ca9e85e"
I20260807 10:48:11.820971 7245 raft_consensus.cc:2379] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dffe7b34510943fdab653decdcc18203 in current term 1: Already voted for candidate d947f53631d94553953f5b019ca9e85e in this term.
I20260807 10:48:11.821208 7159 leader_election.cc:302] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d947f53631d94553953f5b019ca9e85e; no voters: dffe7b34510943fdab653decdcc18203, f9c49d5d1a6a4a2796561864b13cbee4
I20260807 10:48:11.821357 7067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "dffe7b34510943fdab653decdcc18203" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9c49d5d1a6a4a2796561864b13cbee4"
I20260807 10:48:11.821607 7533 raft_consensus.cc:2726] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 10:48:11.821646 7067 raft_consensus.cc:2379] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dffe7b34510943fdab653decdcc18203 in current term 1: Already voted for candidate f9c49d5d1a6a4a2796561864b13cbee4 in this term.
I20260807 10:48:11.822038 7336 leader_election.cc:302] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dffe7b34510943fdab653decdcc18203; no voters: d947f53631d94553953f5b019ca9e85e, f9c49d5d1a6a4a2796561864b13cbee4
I20260807 10:48:11.822338 7532 raft_consensus.cc:2726] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260807 10:48:11.839762 7493 tablet.cc:2369] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:48:13.526268 7549 raft_consensus.cc:482] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:48:13.526506 7549 raft_consensus.cc:504] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:13.527251 7549 leader_election.cc:288] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dffe7b34510943fdab653decdcc18203 (127.11.46.131:43819), f9c49d5d1a6a4a2796561864b13cbee4 (127.11.46.129:39355)
I20260807 10:48:13.527913 7425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "d947f53631d94553953f5b019ca9e85e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffe7b34510943fdab653decdcc18203" is_pre_election: true
I20260807 10:48:13.527909 7067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "d947f53631d94553953f5b019ca9e85e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" is_pre_election: true
I20260807 10:48:13.528165 7425 raft_consensus.cc:2454] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d947f53631d94553953f5b019ca9e85e in term 1.
I20260807 10:48:13.528194 7067 raft_consensus.cc:2454] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d947f53631d94553953f5b019ca9e85e in term 1.
I20260807 10:48:13.528731 7159 leader_election.cc:302] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d947f53631d94553953f5b019ca9e85e, dffe7b34510943fdab653decdcc18203; no voters:
I20260807 10:48:13.529045 7549 raft_consensus.cc:2781] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 10:48:13.529162 7549 raft_consensus.cc:482] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:48:13.529234 7549 raft_consensus.cc:3037] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:48:13.531478 7549 raft_consensus.cc:504] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:13.532141 7549 leader_election.cc:288] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [CANDIDATE]: Term 2 election: Requested vote from peers dffe7b34510943fdab653decdcc18203 (127.11.46.131:43819), f9c49d5d1a6a4a2796561864b13cbee4 (127.11.46.129:39355)
I20260807 10:48:13.532868 7425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "d947f53631d94553953f5b019ca9e85e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dffe7b34510943fdab653decdcc18203"
I20260807 10:48:13.532843 7067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf6f547291142afb56d5177a16982af" candidate_uuid: "d947f53631d94553953f5b019ca9e85e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9c49d5d1a6a4a2796561864b13cbee4"
I20260807 10:48:13.533121 7425 raft_consensus.cc:3037] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:48:13.533118 7067 raft_consensus.cc:3037] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260807 10:48:13.536366 7067 raft_consensus.cc:2454] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d947f53631d94553953f5b019ca9e85e in term 2.
I20260807 10:48:13.536366 7425 raft_consensus.cc:2454] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d947f53631d94553953f5b019ca9e85e in term 2.
I20260807 10:48:13.537048 7163 leader_election.cc:302] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: d947f53631d94553953f5b019ca9e85e, dffe7b34510943fdab653decdcc18203, f9c49d5d1a6a4a2796561864b13cbee4; no voters:
I20260807 10:48:13.537498 7549 raft_consensus.cc:2781] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 2 FOLLOWER]: Leader election won for term 2
I20260807 10:48:13.537941 7549 raft_consensus.cc:686] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 2 LEADER]: Becoming Leader. State: Replica: d947f53631d94553953f5b019ca9e85e, State: Running, Role: LEADER
I20260807 10:48:13.538486 7549 consensus_queue.cc:237] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } }
I20260807 10:48:13.543502 6869 catalog_manager.cc:5495] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e reported cstate change: term changed from 0 to 2, leader changed from <none> to d947f53631d94553953f5b019ca9e85e (127.11.46.130). New cstate: current_term: 2 leader_uuid: "d947f53631d94553953f5b019ca9e85e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d947f53631d94553953f5b019ca9e85e" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 36537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 } health_report { overall_health: UNKNOWN } } }
I20260807 10:48:13.777999 7560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:13.771417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41976 (local address 127.11.46.130:36537)
0807 10:48:13.772179 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:13.772185 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:13.772206 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:48:13.772313 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:13.772317 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:13.772420 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:13.772588 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:48:13.773064 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:13.773866 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:13.775422 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:13.775865 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:13.775991 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:13.776636 (+ 645us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:48:13.777204 (+ 568us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:48:13.777377 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:13.777616 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 10:48:13.777667 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":449,"threads_started":1}
I20260807 10:48:13.787204 7067 raft_consensus.cc:1261] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 2 FOLLOWER]: Refusing update from remote peer d947f53631d94553953f5b019ca9e85e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 10:48:13.787207 7425 raft_consensus.cc:1261] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 2 FOLLOWER]: Refusing update from remote peer d947f53631d94553953f5b019ca9e85e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260807 10:48:13.788167 7551 consensus_queue.cc:1035] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [LEADER]: Connected to new peer: Peer: permanent_uuid: "dffe7b34510943fdab653decdcc18203" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 43819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:48:13.788581 7549 consensus_queue.cc:1035] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9c49d5d1a6a4a2796561864b13cbee4" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 39355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:48:13.823648 6870 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:48:13.824007 6870 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:48:13.829015 6870 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 69dfeec7666844c19693deb4ef8056ad: Sending DeleteTablet for 3 replicas of tablet abf6f547291142afb56d5177a16982af
I20260807 10:48:13.831493 7395 tablet_service.cc:1514] Processing DeleteTablet for tablet abf6f547291142afb56d5177a16982af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:13 UTC) from {username='slave'} at 127.0.0.1:45540
I20260807 10:48:13.831707 7219 tablet_service.cc:1514] Processing DeleteTablet for tablet abf6f547291142afb56d5177a16982af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:13 UTC) from {username='slave'} at 127.0.0.1:41964
I20260807 10:48:13.832470 7042 tablet_service.cc:1514] Processing DeleteTablet for tablet abf6f547291142afb56d5177a16982af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:13 UTC) from {username='slave'} at 127.0.0.1:53764
I20260807 10:48:13.834378 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 6960
I20260807 10:48:13.842161 7580 tablet_replica.cc:330] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: stopping tablet replica
I20260807 10:48:13.842793 7580 raft_consensus.cc:2229] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 10:48:13.843861 7580 raft_consensus.cc:2258] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:13.844878 7582 tablet_replica.cc:330] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4: stopping tablet replica
I20260807 10:48:13.847190 7580 ts_tablet_manager.cc:1905] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:13.847711 7582 raft_consensus.cc:2229] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260807 10:48:13.849066 7581 tablet_replica.cc:330] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: stopping tablet replica
I20260807 10:48:13.850183 7581 raft_consensus.cc:2229] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 2 LEADER]: Raft consensus shutting down.
I20260807 10:48:13.851089 7581 raft_consensus.cc:2258] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:13.852603 7582 raft_consensus.cc:2258] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:13.853624 7581 ts_tablet_manager.cc:1905] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:13.854898 7582 ts_tablet_manager.cc:1905] T abf6f547291142afb56d5177a16982af P f9c49d5d1a6a4a2796561864b13cbee4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:13.855486 7580 ts_tablet_manager.cc:1918] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260807 10:48:13.855746 7580 log.cc:1196] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/abf6f547291142afb56d5177a16982af
I20260807 10:48:13.856344 7580 ts_tablet_manager.cc:1939] T abf6f547291142afb56d5177a16982af P dffe7b34510943fdab653decdcc18203: Deleting consensus metadata
I20260807 10:48:13.858788 6851 catalog_manager.cc:4841] TS dffe7b34510943fdab653decdcc18203 (127.11.46.131:43819): tablet abf6f547291142afb56d5177a16982af (table test-table [id=483e84d23dd34c5b9f28bbb388694d4f]) successfully deleted
I20260807 10:48:13.860291 7587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:13.835953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53776 (local address 127.11.46.129:39355)
0807 10:48:13.846043 (+ 10090us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:13.846050 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:13.846729 (+ 679us) server_negotiation.cc:407] Connection header received
0807 10:48:13.846817 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:13.846823 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:13.846946 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:13.847060 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:13.848855 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:13.850090 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:13.855148 (+ 5058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:13.855984 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:13.856166 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:13.858088 (+ 1922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:13.858100 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:13.858119 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:13.858931 (+ 812us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:13.859023 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:13.859053 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:13.859174 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:13.859746 (+ 572us) server_negotiation.cc:299] Negotiation successful
0807 10:48:13.859876 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9903,"thread_start_us":9754,"threads_started":1}
I20260807 10:48:13.861426 7127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:13.863204 7581 ts_tablet_manager.cc:1918] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260807 10:48:13.863533 7581 log.cc:1196] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/abf6f547291142afb56d5177a16982af
I20260807 10:48:13.864480 7581 ts_tablet_manager.cc:1939] T abf6f547291142afb56d5177a16982af P d947f53631d94553953f5b019ca9e85e: Deleting consensus metadata
I20260807 10:48:13.867179 6854 catalog_manager.cc:4841] TS d947f53631d94553953f5b019ca9e85e (127.11.46.130:36537): tablet abf6f547291142afb56d5177a16982af (table test-table [id=483e84d23dd34c5b9f28bbb388694d4f]) successfully deleted
I20260807 10:48:13.958666 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 6960
W20260807 10:48:13.991762 6854 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.46.129:39355 (error 108)
I20260807 10:48:13.992491 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 7140
I20260807 10:48:13.994786 7590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:13.993378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.0.0.1:53792)
0807 10:48:13.994285 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:13.994510 (+ 225us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:39355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":773,"thread_start_us":560,"threads_started":1}
W20260807 10:48:13.995124 6854 catalog_manager.cc:4584] TS f9c49d5d1a6a4a2796561864b13cbee4 (127.11.46.129:39355): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet abf6f547291142afb56d5177a16982af: Network error: Client connection negotiation failed: client connection to 127.11.46.129:39355: connect: Connection refused (error 111)
I20260807 10:48:14.001000 7560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:13.993749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41982 (local address 127.11.46.130:36537)
0807 10:48:13.994032 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:13.994037 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:13.994058 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:48:13.994126 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:13.994131 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:13.994240 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:13.994336 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:13.994816 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:13.995751 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:13.997144 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:13.997724 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:13.997870 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:13.999102 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:13.999115 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:13.999137 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:14.000056 (+ 919us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:14.000136 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:14.000167 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:14.000291 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:14.000443 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 10:48:14.000570 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260807 10:48:14.001850 7302 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:14.049149 7590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:14.048546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.0.0.1:53806)
0807 10:48:14.048865 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:14.048977 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:39355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260807 10:48:14.050437 7590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:14.049969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.0.0.1:53808)
0807 10:48:14.050130 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:14.050228 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:39355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 10:48:14.111135 7590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:14.110646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.0.0.1:53810)
0807 10:48:14.110865 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:14.110969 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:39355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 10:48:14.112278 7590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:14.111863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.0.0.1:53826)
0807 10:48:14.112041 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:14.112118 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:39355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 10:48:14.125670 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 7140
I20260807 10:48:14.154117 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 7314
I20260807 10:48:14.161751 7593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:14.154942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45542 (local address 127.11.46.131:43819)
0807 10:48:14.155556 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:14.155560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:14.155581 (+ 21us) server_negotiation.cc:407] Connection header received
0807 10:48:14.155644 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:14.155648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:14.155740 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:14.155853 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:14.156236 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:14.157001 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:14.158427 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:14.158865 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:14.158985 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:14.160085 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:14.160094 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:14.160111 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:14.160831 (+ 720us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:14.160894 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:14.160920 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:14.161027 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:14.161213 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 10:48:14.161321 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":343,"threads_started":1}
I20260807 10:48:14.162467 7486 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:14.193255 7590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:14.192709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.0.0.1:53828)
0807 10:48:14.192998 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:14.193102 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:39355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260807 10:48:14.194550 7590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:14.194060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.0.0.1:53832)
0807 10:48:14.194306 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:14.194387 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:39355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260807 10:48:14.256994 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 7314
I20260807 10:48:14.287175 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 6830
I20260807 10:48:14.288333 6920 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:14.403836 7590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:14.403091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:39355 (local address 127.0.0.1:53842)
0807 10:48:14.403352 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:14.403501 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:39355: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 10:48:14.404065 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 6830
2026-08-07T10:48:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (5215 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:14 dist-test-slave-42z9 krb5kdc[7600](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:14 dist-test-slave-42z9 krb5kdc[7600](info): set up 2 sockets
Aug 07 10:48:14 dist-test-slave-42z9 krb5kdc[7600](info): commencing operation
krb5kdc: starting...
W20260807 10:48:15.690459 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.008s sys 0.059s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:15 dist-test-slave-42z9 krb5kdc[7600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:48:16.086704 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:42807
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:44333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:42807
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:16.477196 7618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:16.477586 7618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:16.477700 7618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:16.485425 7618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:16.485599 7618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:16.485669 7618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:16.485760 7618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:16.485818 7618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:16.496582 7618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:44333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:42807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:42807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:16.498108 7618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:16.499586 7618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:16.512064 7625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:16.512168 7626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:16.512132 7631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:16.513222 7618 server_base.cc:1034] running on GCE node
I20260807 10:48:16.514150 7618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:16.515799 7618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:16.517062 7618 hybrid_clock.cc:648] HybridClock initialized: now 1786099696516998 us; error 53 us; skew 500 ppm
I20260807 10:48:16.517524 7618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:16 dist-test-slave-42z9 krb5kdc[7600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099696, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:16.525130 7618 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:48:16.527087 7618 webserver.cc:460] Webserver started at http://127.11.46.190:44309/ using document root <none> and password file <none>
I20260807 10:48:16.528002 7618 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:16.528148 7618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:16.528524 7618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:16.532176 7618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "b7f28ffba9034843bd5a28bbe5de9cda"
format_stamp: "Formatted at 2026-08-07 10:48:16 on dist-test-slave-42z9"
server_key: "29e74cc81353d5a26ffe4137c864bcb9"
server_key_iv: "697aca9c9d298c937c1572210ad654af"
server_key_version: "encryptionkey@0"
I20260807 10:48:16.533118 7618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "b7f28ffba9034843bd5a28bbe5de9cda"
format_stamp: "Formatted at 2026-08-07 10:48:16 on dist-test-slave-42z9"
server_key: "29e74cc81353d5a26ffe4137c864bcb9"
server_key_iv: "697aca9c9d298c937c1572210ad654af"
server_key_version: "encryptionkey@0"
I20260807 10:48:16.539381 7618 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260807 10:48:16.543586 7640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:16.545221 7618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 10:48:16.545497 7618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "b7f28ffba9034843bd5a28bbe5de9cda"
format_stamp: "Formatted at 2026-08-07 10:48:16 on dist-test-slave-42z9"
server_key: "29e74cc81353d5a26ffe4137c864bcb9"
server_key_iv: "697aca9c9d298c937c1572210ad654af"
server_key_version: "encryptionkey@0"
I20260807 10:48:16.545787 7618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:16.560365 7618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:16.565207 7618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:16.565537 7618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:16.584332 7618 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:42807
I20260807 10:48:16.584367 7714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:42807 every 8 connection(s)
I20260807 10:48:16.585857 7618 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:16.587399 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 7618
I20260807 10:48:16.587652 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:16.588156 11450 external_mini_cluster.cc:1428] Setting key 03cd66e23979ff8845d46b1de24e9693
I20260807 10:48:16.590543 7717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:48:16 dist-test-slave-42z9 krb5kdc[7600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:48:16.605691 7717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda: Bootstrap starting.
I20260807 10:48:16.609851 7717 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:16.611045 7717 log.cc:824] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:16.614468 7717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda: No bootstrap required, opened a new log
I20260807 10:48:16.614619 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:16.590228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35566 (local address 127.11.46.190:42807)
0807 10:48:16.591193 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:16.591211 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:16.591265 (+ 54us) server_negotiation.cc:407] Connection header received
0807 10:48:16.593780 (+ 2515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:16.593815 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:16.594446 (+ 631us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:16.594967 (+ 521us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:16.596536 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:16.598717 (+ 2181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:16.600152 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:16.601223 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:16.601481 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:16.606483 (+ 5002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:16.606494 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:16.606536 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:16.606604 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:16.609986 (+ 3382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:16.610829 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:16.610837 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:16.610845 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:16.611069 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:16.611522 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:16.611528 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:16.611531 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:16.612183 (+ 652us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:16.612502 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:16.613035 (+ 533us) server_negotiation.cc:299] Negotiation successful
0807 10:48:16.613557 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":427,"threads_started":1}
I20260807 10:48:16.623441 7717 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f28ffba9034843bd5a28bbe5de9cda" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42807 } }
I20260807 10:48:16.623978 7717 raft_consensus.cc:374] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:16.624095 7717 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7f28ffba9034843bd5a28bbe5de9cda, State: Initialized, Role: FOLLOWER
I20260807 10:48:16.624739 7717 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f28ffba9034843bd5a28bbe5de9cda" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42807 } }
I20260807 10:48:16.624998 7717 raft_consensus.cc:388] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:16.625140 7717 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:16.625315 7717 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:16.627943 7717 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f28ffba9034843bd5a28bbe5de9cda" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42807 } }
I20260807 10:48:16.628538 7717 leader_election.cc:302] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7f28ffba9034843bd5a28bbe5de9cda; no voters:
I20260807 10:48:16.629168 7717 leader_election.cc:288] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:16.629318 7725 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:16.630031 7725 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [term 1 LEADER]: Becoming Leader. State: Replica: b7f28ffba9034843bd5a28bbe5de9cda, State: Running, Role: LEADER
I20260807 10:48:16.630690 7725 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f28ffba9034843bd5a28bbe5de9cda" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42807 } }
I20260807 10:48:16.631422 7717 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:16.634048 7727 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b7f28ffba9034843bd5a28bbe5de9cda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f28ffba9034843bd5a28bbe5de9cda" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42807 } } }
I20260807 10:48:16.635056 7727 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:16.634020 7728 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7f28ffba9034843bd5a28bbe5de9cda. Latest consensus state: current_term: 1 leader_uuid: "b7f28ffba9034843bd5a28bbe5de9cda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7f28ffba9034843bd5a28bbe5de9cda" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42807 } } }
I20260807 10:48:16.635912 7728 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:16.642596 7738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:16.647773 7738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:16.658555 7738 catalog_manager.cc:1347] Generated new cluster ID: 3ff50096f1514003bc222c3bd7bf0693
I20260807 10:48:16.658696 7738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:16.684042 7738 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:16.686013 7738 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:16.695590 7738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda: Generated new TSK 0
I20260807 10:48:16.696635 7738 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.46.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
Entry for principal kudu/127.11.46.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab.
I20260807 10:48:16.794878 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42807
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:44333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:17.196712 7759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:17.197046 7759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:17.197190 7759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:17.205132 7759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:17.205284 7759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:17.205490 7759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:48:17.217001 7759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:44333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.129.keytab
--principal=kudu/127.11.46.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:17.218607 7759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:17.220214 7759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:17.235503 7767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:17.235632 7771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:17.235550 7764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:17.236675 7759 server_base.cc:1034] running on GCE node
I20260807 10:48:17.237380 7759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:17.238483 7759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:17.239737 7759 hybrid_clock.cc:648] HybridClock initialized: now 1786099697239659 us; error 54 us; skew 500 ppm
I20260807 10:48:17.240118 7759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:17 dist-test-slave-42z9 krb5kdc[7600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099697, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:17.243628 7759 init.cc:377] Logged in from keytab as kudu/127.11.46.129@KRBTEST.COM (short username kudu)
I20260807 10:48:17.245322 7759 webserver.cc:460] Webserver started at http://127.11.46.129:38995/ using document root <none> and password file <none>
I20260807 10:48:17.246163 7759 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:17.246326 7759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:17.246695 7759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:17.250317 7759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "bdd8ce7819a74b2c841e0373f4e96a80"
format_stamp: "Formatted at 2026-08-07 10:48:17 on dist-test-slave-42z9"
server_key: "eb20b5deda97d5768771ffe057a8613c"
server_key_iv: "50a92d074afee59e913a98697c70ecb2"
server_key_version: "encryptionkey@0"
I20260807 10:48:17.251278 7759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "bdd8ce7819a74b2c841e0373f4e96a80"
format_stamp: "Formatted at 2026-08-07 10:48:17 on dist-test-slave-42z9"
server_key: "eb20b5deda97d5768771ffe057a8613c"
server_key_iv: "50a92d074afee59e913a98697c70ecb2"
server_key_version: "encryptionkey@0"
I20260807 10:48:17.257659 7759 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260807 10:48:17.262115 7783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:17.263831 7759 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 10:48:17.264040 7759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "bdd8ce7819a74b2c841e0373f4e96a80"
format_stamp: "Formatted at 2026-08-07 10:48:17 on dist-test-slave-42z9"
server_key: "eb20b5deda97d5768771ffe057a8613c"
server_key_iv: "50a92d074afee59e913a98697c70ecb2"
server_key_version: "encryptionkey@0"
I20260807 10:48:17.264274 7759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:17.286782 7759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:17.292069 7759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:17.292439 7759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:17.293825 7759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:17.295588 7759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:17.295692 7759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:17.295842 7759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:17.295902 7759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:17.332067 7759 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:33307
I20260807 10:48:17.332110 7938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:33307 every 8 connection(s)
I20260807 10:48:17.333678 7759 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:48:17.337031 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 7759
I20260807 10:48:17.337209 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:48:17.337898 11450 external_mini_cluster.cc:1428] Setting key c10a9ff4f0bdff5cad5bd5ca7d824b16
Aug 07 10:48:17 dist-test-slave-42z9 krb5kdc[7600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099697, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.129@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:48:17.358291 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:17.336474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:36861 (local address 127.11.46.190:42807)
0807 10:48:17.337025 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:17.337032 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:17.338421 (+ 1389us) server_negotiation.cc:407] Connection header received
0807 10:48:17.340863 (+ 2442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:17.340867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:17.340942 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:17.341038 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:17.343361 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:17.344155 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:17.346525 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:17.346974 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:17.347092 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:17.351849 (+ 4757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:17.351855 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:17.351859 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:17.351902 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:17.354615 (+ 2713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:17.355678 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:17.355683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:17.355685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:17.355823 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:17.356318 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:17.356321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:17.356323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:17.356619 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:17.356738 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:17.357775 (+ 1037us) server_negotiation.cc:299] Negotiation successful
0807 10:48:17.358009 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":268,"threads_started":1}
I20260807 10:48:17.359589 7942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:17.337120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42807 (local address 127.11.46.129:36861)
0807 10:48:17.338190 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:17.338267 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:17.340505 (+ 2238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:17.341348 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:17.341360 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:17.342224 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:17.343150 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:17.343180 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:17.344341 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:17.344346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:17.346327 (+ 1981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:17.346345 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:17.347245 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:17.347252 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:17.347569 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:17.348384 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:48:17.348423 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:17.351515 (+ 3092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:17.354819 (+ 3304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:17.354831 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:17.354853 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:17.355534 (+ 681us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:17.355926 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:17.355930 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:17.355933 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:17.356216 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:17.356747 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:17.356756 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:17.357261 (+ 505us) client_negotiation.cc:769] Sending connection context
0807 10:48:17.357633 (+ 372us) client_negotiation.cc:240] Negotiation successful
0807 10:48:17.358247 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":452,"threads_started":1}
I20260807 10:48:17.361264 7939 heartbeater.cc:347] Connected to a master server at 127.11.46.190:42807
I20260807 10:48:17.361613 7939 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:17.362391 7939 heartbeater.cc:511] Master 127.11.46.190:42807 requested a full tablet report, sending...
I20260807 10:48:17.364686 7671 ts_manager.cc:194] Registered new tserver with Master: bdd8ce7819a74b2c841e0373f4e96a80 (127.11.46.129:33307)
I20260807 10:48:17.366241 7671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.129@KRBTEST.COM'} at 127.11.46.129:36861
WARNING: no policy specified for kudu/127.11.46.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
Entry for principal kudu/127.11.46.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab.
I20260807 10:48:17.420280 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42807
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:44333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:17.815937 7950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:17.816284 7950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:17.816434 7950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:17.824278 7950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:17.824446 7950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:17.824621 7950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:48:17.835723 7950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:44333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.130.keytab
--principal=kudu/127.11.46.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:17.837256 7950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:17.838800 7950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:17.854154 7956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:17.854193 7959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:17.854097 7957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:17.855213 7950 server_base.cc:1034] running on GCE node
I20260807 10:48:17.855934 7950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:17.857061 7950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:17.858314 7950 hybrid_clock.cc:648] HybridClock initialized: now 1786099697858246 us; error 53 us; skew 500 ppm
I20260807 10:48:17.858721 7950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:17 dist-test-slave-42z9 krb5kdc[7600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099697, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:17.862490 7950 init.cc:377] Logged in from keytab as kudu/127.11.46.130@KRBTEST.COM (short username kudu)
I20260807 10:48:17.864269 7950 webserver.cc:460] Webserver started at http://127.11.46.130:38341/ using document root <none> and password file <none>
I20260807 10:48:17.865130 7950 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:17.865273 7950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:17.865669 7950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:17.869184 7950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "f1e701d5cde9497083e9962a3c76cf8f"
format_stamp: "Formatted at 2026-08-07 10:48:17 on dist-test-slave-42z9"
server_key: "422f034f6055a0bbbc3398c096e670ac"
server_key_iv: "c5dca55904eb8ba9e5e55e227cc59d7c"
server_key_version: "encryptionkey@0"
I20260807 10:48:17.870226 7950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "f1e701d5cde9497083e9962a3c76cf8f"
format_stamp: "Formatted at 2026-08-07 10:48:17 on dist-test-slave-42z9"
server_key: "422f034f6055a0bbbc3398c096e670ac"
server_key_iv: "c5dca55904eb8ba9e5e55e227cc59d7c"
server_key_version: "encryptionkey@0"
I20260807 10:48:17.876631 7950 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:48:17.880978 7967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:17.882623 7950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 10:48:17.882828 7950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "f1e701d5cde9497083e9962a3c76cf8f"
format_stamp: "Formatted at 2026-08-07 10:48:17 on dist-test-slave-42z9"
server_key: "422f034f6055a0bbbc3398c096e670ac"
server_key_iv: "c5dca55904eb8ba9e5e55e227cc59d7c"
server_key_version: "encryptionkey@0"
I20260807 10:48:17.883049 7950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:17.905378 7950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:17.909997 7950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:17.910315 7950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:17.911432 7950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:17.913044 7950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:17.913133 7950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:17.913268 7950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:17.913323 7950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:17.947017 7950 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:33317
I20260807 10:48:17.947057 8125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:33317 every 8 connection(s)
I20260807 10:48:17.948483 7950 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:48:17.951038 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 7950
I20260807 10:48:17.951246 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:48:17.951856 11450 external_mini_cluster.cc:1428] Setting key 680529654a7f8a919619b2eabccc5a86
Aug 07 10:48:17 dist-test-slave-42z9 krb5kdc[7600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099697, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.130@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:48:17.971345 8128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:17.951581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:51129 (local address 127.11.46.190:42807)
0807 10:48:17.952059 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:17.952064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:17.953658 (+ 1594us) server_negotiation.cc:407] Connection header received
0807 10:48:17.955930 (+ 2272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:17.955935 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:17.956030 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:17.956133 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:17.957977 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:17.958742 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:17.960412 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:17.960887 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:17.961007 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:17.964758 (+ 3751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:17.964763 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:17.964767 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:17.964804 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:17.967506 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:17.968440 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:17.968445 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:17.968447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:17.968596 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:17.969284 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:17.969289 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:17.969291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:17.969695 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:17.969832 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:17.970837 (+ 1005us) server_negotiation.cc:299] Negotiation successful
0807 10:48:17.971073 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":234,"threads_started":1}
I20260807 10:48:17.972607 8129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:17.952412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42807 (local address 127.11.46.130:51129)
0807 10:48:17.953432 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:17.953518 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:17.955600 (+ 2082us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:17.956439 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:17.956449 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:17.957042 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:17.957774 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:17.957796 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:17.958916 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:17.958921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:17.960251 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:17.960266 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:17.961161 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:17.961170 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:17.961402 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:17.962154 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:48:17.962185 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:17.964471 (+ 2286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:17.967684 (+ 3213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:17.967695 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:17.967718 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:17.968297 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:17.968755 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:17.968760 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:17.968763 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:17.969073 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:17.969842 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:17.969851 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:17.970376 (+ 525us) client_negotiation.cc:769] Sending connection context
0807 10:48:17.970743 (+ 367us) client_negotiation.cc:240] Negotiation successful
0807 10:48:17.971358 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":387,"threads_started":1}
I20260807 10:48:17.974260 8126 heartbeater.cc:347] Connected to a master server at 127.11.46.190:42807
I20260807 10:48:17.974658 8126 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:17.975682 8126 heartbeater.cc:511] Master 127.11.46.190:42807 requested a full tablet report, sending...
I20260807 10:48:17.977712 7671 ts_manager.cc:194] Registered new tserver with Master: f1e701d5cde9497083e9962a3c76cf8f (127.11.46.130:33317)
I20260807 10:48:17.978616 7671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.130@KRBTEST.COM'} at 127.11.46.130:51129
WARNING: no policy specified for kudu/127.11.46.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
Entry for principal kudu/127.11.46.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab.
I20260807 10:48:18.036237 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42807
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:44333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:48:18.369671 7939 heartbeater.cc:503] Master 127.11.46.190:42807 was elected leader, sending a full tablet report...
W20260807 10:48:18.428277 8135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:18.428619 8135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:18.428730 8135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:18.436473 8135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:18.436618 8135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:18.436749 8135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:48:18.447268 8135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:44333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.131.keytab
--principal=kudu/127.11.46.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:42807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:18.448725 8135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:18.450378 8135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:18.464677 8140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:18.464677 8145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:18.464768 8143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:18.466113 8135 server_base.cc:1034] running on GCE node
I20260807 10:48:18.466835 8135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:18.467980 8135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:18.469271 8135 hybrid_clock.cc:648] HybridClock initialized: now 1786099698469200 us; error 51 us; skew 500 ppm
I20260807 10:48:18.469743 8135 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:18 dist-test-slave-42z9 krb5kdc[7600](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099698, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:18.473263 8135 init.cc:377] Logged in from keytab as kudu/127.11.46.131@KRBTEST.COM (short username kudu)
I20260807 10:48:18.475142 8135 webserver.cc:460] Webserver started at http://127.11.46.131:43605/ using document root <none> and password file <none>
I20260807 10:48:18.475986 8135 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:18.476127 8135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:18.476498 8135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:18.479894 8135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "415a01ec338e429694bca7bf6c87557e"
format_stamp: "Formatted at 2026-08-07 10:48:18 on dist-test-slave-42z9"
server_key: "d805ed6f55bbc6099f26c458b5c410d8"
server_key_iv: "5d3634583b940d5f87443a21b16f2ebc"
server_key_version: "encryptionkey@0"
I20260807 10:48:18.480790 8135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "415a01ec338e429694bca7bf6c87557e"
format_stamp: "Formatted at 2026-08-07 10:48:18 on dist-test-slave-42z9"
server_key: "d805ed6f55bbc6099f26c458b5c410d8"
server_key_iv: "5d3634583b940d5f87443a21b16f2ebc"
server_key_version: "encryptionkey@0"
I20260807 10:48:18.487205 8135 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260807 10:48:18.491604 8153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:18.493402 8135 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 10:48:18.493693 8135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "415a01ec338e429694bca7bf6c87557e"
format_stamp: "Formatted at 2026-08-07 10:48:18 on dist-test-slave-42z9"
server_key: "d805ed6f55bbc6099f26c458b5c410d8"
server_key_iv: "5d3634583b940d5f87443a21b16f2ebc"
server_key_version: "encryptionkey@0"
I20260807 10:48:18.493942 8135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:18.519096 8135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:18.523762 8135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:18.524087 8135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:18.525213 8135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:18.526840 8135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:18.526937 8135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:18.527062 8135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:18.527117 8135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:18.560943 8135 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:40029
I20260807 10:48:18.561015 8308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:40029 every 8 connection(s)
I20260807 10:48:18.562521 8135 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:48:18.567808 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 8135
I20260807 10:48:18.568018 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:48:18.568639 11450 external_mini_cluster.cc:1428] Setting key f22fc7457f91ec23b50cee729fee3af2
Aug 07 10:48:18 dist-test-slave-42z9 krb5kdc[7600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099698, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.131@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:48:18.584921 8312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.565288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:53821 (local address 127.11.46.190:42807)
0807 10:48:18.565814 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:18.565818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:18.566788 (+ 970us) server_negotiation.cc:407] Connection header received
0807 10:48:18.569352 (+ 2564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:18.569358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:18.569485 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:18.569583 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:18.571422 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.572317 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.574019 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.574436 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.574553 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.578279 (+ 3726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:18.578285 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:18.578288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:18.578327 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:18.580842 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:18.581824 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:18.581830 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:18.581833 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:18.582023 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:18.582663 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:18.582668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:18.582671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:18.583040 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:18.583216 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:18.584258 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0807 10:48:18.584520 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":262,"threads_started":1}
I20260807 10:48:18.586025 8315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.565843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42807 (local address 127.11.46.131:53821)
0807 10:48:18.566611 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:18.566664 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:18.569009 (+ 2345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:18.569870 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:18.569880 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:18.570588 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:18.571243 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.571262 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.572478 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.572483 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.573861 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.573880 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.574680 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.574687 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.574933 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.575580 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:48:18.575606 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:18.578003 (+ 2397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:18.581041 (+ 3038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:18.581050 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:18.581067 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:18.581676 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:18.582182 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:48:18.582186 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:48:18.582189 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:48:18.582528 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:48:18.583181 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:18.583188 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:18.583686 (+ 498us) client_negotiation.cc:769] Sending connection context
0807 10:48:18.584039 (+ 353us) client_negotiation.cc:240] Negotiation successful
0807 10:48:18.584664 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":284,"threads_started":1}
I20260807 10:48:18.587617 8309 heartbeater.cc:347] Connected to a master server at 127.11.46.190:42807
I20260807 10:48:18.588002 8309 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:18.588991 8309 heartbeater.cc:511] Master 127.11.46.190:42807 requested a full tablet report, sending...
I20260807 10:48:18.590845 7671 ts_manager.cc:194] Registered new tserver with Master: 415a01ec338e429694bca7bf6c87557e (127.11.46.131:40029)
I20260807 10:48:18.591771 7671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.46.131@KRBTEST.COM'} at 127.11.46.131:53821
I20260807 10:48:18.596951 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:48:18.614710 8312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.601519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35578 (local address 127.11.46.190:42807)
0807 10:48:18.601711 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:18.601716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:18.602186 (+ 470us) server_negotiation.cc:407] Connection header received
0807 10:48:18.602343 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:18.602347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:18.602438 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:18.602534 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:18.604040 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.604797 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.606181 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.606623 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.606735 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.609235 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:18.609240 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:18.609243 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:18.609278 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:18.611905 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:18.612691 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:18.612694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:18.612697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:18.612853 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:18.613203 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:18.613207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:18.613209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:18.613660 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:18.613864 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:18.614226 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 10:48:18.614458 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:48:18.619155 7671 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:48:18.626616 7671 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:48:18.663357 8332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.641109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:33317 (local address 127.0.0.1:54416)
0807 10:48:18.653753 (+ 12644us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:18.653772 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:18.653911 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:18.655104 (+ 1193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:18.655109 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:18.655136 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:18.655586 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.655599 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.657772 (+ 2173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.657778 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.659957 (+ 2179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.659972 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.661916 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.661924 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.662324 (+ 400us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.662473 (+ 149us) client_negotiation.cc:769] Sending connection context
0807 10:48:18.662621 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 10:48:18.662876 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12517,"mutex_wait_us":124,"thread_start_us":12353,"threads_started":1}
I20260807 10:48:18.663672 8331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.640896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49094 (local address 127.11.46.129:33307)
0807 10:48:18.652223 (+ 11327us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:18.652234 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:18.653411 (+ 1177us) server_negotiation.cc:407] Connection header received
0807 10:48:18.653569 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:18.653579 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:18.653890 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:18.654870 (+ 980us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:18.655158 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.656777 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.659908 (+ 3131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.661600 (+ 1692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.662755 (+ 1155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.663041 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:18.663131 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 10:48:18.663330 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11107,"thread_start_us":10905,"threads_started":1}
I20260807 10:48:18.664466 8330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.640609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33307 (local address 127.0.0.1:49094)
0807 10:48:18.652797 (+ 12188us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:18.652868 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:18.653131 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:18.654171 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:18.654180 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:18.654224 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:18.654658 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.654673 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.656953 (+ 2280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.656958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.659646 (+ 2688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.659666 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.661935 (+ 2269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.661941 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.662321 (+ 380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.662473 (+ 152us) client_negotiation.cc:769] Sending connection context
0807 10:48:18.662621 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 10:48:18.664015 (+ 1394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11855,"mutex_wait_us":1278,"thread_start_us":11653,"threads_started":1}
I20260807 10:48:18.665324 8333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.641228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54416 (local address 127.11.46.130:33317)
0807 10:48:18.654237 (+ 13009us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:18.654246 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:18.654276 (+ 30us) server_negotiation.cc:407] Connection header received
0807 10:48:18.654376 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:18.654383 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:18.654626 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:18.655825 (+ 1199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:18.656089 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.657603 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.660187 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.661651 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.664376 (+ 2725us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.664656 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:18.664744 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 10:48:18.664964 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12807,"thread_start_us":13527,"threads_started":1}
I20260807 10:48:18.669551 8034 tablet_service.cc:1467] Processing CreateTablet for tablet 2a2e05fa48df458c910369d24f68525d (DEFAULT_TABLE table=test-table [id=7bfeac3755c3476db9ae2b24ba763f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:18.669468 7844 tablet_service.cc:1467] Processing CreateTablet for tablet 2a2e05fa48df458c910369d24f68525d (DEFAULT_TABLE table=test-table [id=7bfeac3755c3476db9ae2b24ba763f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:18.671149 8034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a2e05fa48df458c910369d24f68525d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:18.671237 7844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a2e05fa48df458c910369d24f68525d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:18.675446 8332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.654900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:40029 (local address 127.0.0.1:50688)
0807 10:48:18.664046 (+ 9146us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:18.664068 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:18.664203 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:18.667209 (+ 3006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:18.667215 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:18.667254 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:18.667478 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.667493 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.670060 (+ 2567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.670067 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.671995 (+ 1928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.672020 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.674515 (+ 2495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.674523 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.674764 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.674803 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 10:48:18.674922 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 10:48:18.675098 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9037,"thread_start_us":10010,"threads_started":1}
I20260807 10:48:18.675768 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.654684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50688 (local address 127.11.46.131:40029)
0807 10:48:18.665688 (+ 11004us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:18.665697 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:18.665736 (+ 39us) server_negotiation.cc:407] Connection header received
0807 10:48:18.665853 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:18.665863 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:18.666166 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:18.667640 (+ 1474us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:18.668037 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.669858 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.672248 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.673953 (+ 1705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.674104 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.674377 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:18.675121 (+ 744us) server_negotiation.cc:299] Negotiation successful
0807 10:48:18.675382 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10773,"thread_start_us":10545,"threads_started":1}
I20260807 10:48:18.680811 8214 tablet_service.cc:1467] Processing CreateTablet for tablet 2a2e05fa48df458c910369d24f68525d (DEFAULT_TABLE table=test-table [id=7bfeac3755c3476db9ae2b24ba763f72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:18.682788 8214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a2e05fa48df458c910369d24f68525d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:18.685380 8337 tablet_bootstrap.cc:492] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: Bootstrap starting.
I20260807 10:48:18.687848 8340 tablet_bootstrap.cc:492] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: Bootstrap starting.
I20260807 10:48:18.690045 8337 tablet_bootstrap.cc:654] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:18.691572 8337 log.cc:824] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:18.692049 8340 tablet_bootstrap.cc:654] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:18.693367 8340 log.cc:824] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:18.696352 8337 tablet_bootstrap.cc:492] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: No bootstrap required, opened a new log
I20260807 10:48:18.696691 8337 ts_tablet_manager.cc:1397] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260807 10:48:18.697082 8340 tablet_bootstrap.cc:492] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: No bootstrap required, opened a new log
I20260807 10:48:18.697414 8340 ts_tablet_manager.cc:1397] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260807 10:48:18.698926 8344 tablet_bootstrap.cc:492] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: Bootstrap starting.
I20260807 10:48:18.703580 8344 tablet_bootstrap.cc:654] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:18.705194 8344 log.cc:824] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:18.705824 8340 raft_consensus.cc:348] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 } } peers { permanent_uuid: "f1e701d5cde9497083e9962a3c76cf8f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 33317 } } peers { permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 } }
I20260807 10:48:18.706405 8340 raft_consensus.cc:374] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:18.706535 8340 raft_consensus.cc:729] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e701d5cde9497083e9962a3c76cf8f, State: Initialized, Role: FOLLOWER
I20260807 10:48:18.707326 8340 consensus_queue.cc:260] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 } } peers { permanent_uuid: "f1e701d5cde9497083e9962a3c76cf8f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 33317 } } peers { permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 } }
I20260807 10:48:18.708248 8337 raft_consensus.cc:348] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 } } peers { permanent_uuid: "f1e701d5cde9497083e9962a3c76cf8f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 33317 } } peers { permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 } }
I20260807 10:48:18.708783 8337 raft_consensus.cc:374] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:18.708909 8337 raft_consensus.cc:729] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdd8ce7819a74b2c841e0373f4e96a80, State: Initialized, Role: FOLLOWER
I20260807 10:48:18.708964 8126 heartbeater.cc:503] Master 127.11.46.190:42807 was elected leader, sending a full tablet report...
I20260807 10:48:18.709813 8340 ts_tablet_manager.cc:1428] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260807 10:48:18.709786 8337 consensus_queue.cc:260] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 } } peers { permanent_uuid: "f1e701d5cde9497083e9962a3c76cf8f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 33317 } } peers { permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 } }
I20260807 10:48:18.711119 8344 tablet_bootstrap.cc:492] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: No bootstrap required, opened a new log
I20260807 10:48:18.711546 8344 ts_tablet_manager.cc:1397] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260807 10:48:18.712348 8337 ts_tablet_manager.cc:1428] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260807 10:48:18.720773 8344 raft_consensus.cc:348] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 } } peers { permanent_uuid: "f1e701d5cde9497083e9962a3c76cf8f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 33317 } } peers { permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 } }
I20260807 10:48:18.721251 8344 raft_consensus.cc:374] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:18.721367 8344 raft_consensus.cc:729] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415a01ec338e429694bca7bf6c87557e, State: Initialized, Role: FOLLOWER
I20260807 10:48:18.722088 8344 consensus_queue.cc:260] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 } } peers { permanent_uuid: "f1e701d5cde9497083e9962a3c76cf8f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 33317 } } peers { permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 } }
I20260807 10:48:18.723387 8309 heartbeater.cc:503] Master 127.11.46.190:42807 was elected leader, sending a full tablet report...
I20260807 10:48:18.724237 8344 ts_tablet_manager.cc:1428] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: Time spent starting tablet: real 0.013s user 0.007s sys 0.004s
I20260807 10:48:18.787756 8346 raft_consensus.cc:482] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:48:18.788146 8346 raft_consensus.cc:504] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 } } peers { permanent_uuid: "f1e701d5cde9497083e9962a3c76cf8f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 33317 } } peers { permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 } }
I20260807 10:48:18.790138 8346 leader_election.cc:288] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdd8ce7819a74b2c841e0373f4e96a80 (127.11.46.129:33307), 415a01ec338e429694bca7bf6c87557e (127.11.46.131:40029)
I20260807 10:48:18.797798 8331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.790695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:55743 (local address 127.11.46.129:33307)
0807 10:48:18.790978 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:18.790985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:18.791378 (+ 393us) server_negotiation.cc:407] Connection header received
0807 10:48:18.791628 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:18.791635 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:18.791723 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:18.791830 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:18.792506 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.793480 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.795621 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.796668 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.796808 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.796871 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:18.797330 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 10:48:18.797519 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 10:48:18.798025 8351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.790557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:33307 (local address 127.11.46.130:55743)
0807 10:48:18.791245 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:18.791261 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:18.791451 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:18.791887 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:18.791892 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:18.791924 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:18.792333 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.792348 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.793627 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.793634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.795417 (+ 1783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.795434 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.796935 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.796942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.797146 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.797188 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 10:48:18.797287 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 10:48:18.797487 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":359,"threads_started":1}
I20260807 10:48:18.798322 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.791568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:33487 (local address 127.11.46.131:40029)
0807 10:48:18.791747 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:18.791752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:18.792169 (+ 417us) server_negotiation.cc:407] Connection header received
0807 10:48:18.792291 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:18.792297 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:18.792378 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:18.792463 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:18.793110 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.794195 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.796163 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.797135 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.797343 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.797415 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:18.797858 (+ 443us) server_negotiation.cc:299] Negotiation successful
0807 10:48:18.798014 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260807 10:48:18.798889 8352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.791383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:40029 (local address 127.11.46.130:33487)
0807 10:48:18.792057 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:18.792074 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:18.792180 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:18.792500 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:18.792504 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:18.792529 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:18.792903 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.792916 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.794366 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.794370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.795967 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:18.795984 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.797476 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.797484 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:18.797688 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.797720 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 10:48:18.797822 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 10:48:18.797963 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":361,"threads_started":1}
I20260807 10:48:18.799633 7873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a2e05fa48df458c910369d24f68525d" candidate_uuid: "f1e701d5cde9497083e9962a3c76cf8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" is_pre_election: true
I20260807 10:48:18.800042 8242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a2e05fa48df458c910369d24f68525d" candidate_uuid: "f1e701d5cde9497083e9962a3c76cf8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415a01ec338e429694bca7bf6c87557e" is_pre_election: true
I20260807 10:48:18.800347 7873 raft_consensus.cc:2454] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1e701d5cde9497083e9962a3c76cf8f in term 0.
I20260807 10:48:18.800566 8242 raft_consensus.cc:2454] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1e701d5cde9497083e9962a3c76cf8f in term 0.
I20260807 10:48:18.801129 7968 leader_election.cc:302] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdd8ce7819a74b2c841e0373f4e96a80, f1e701d5cde9497083e9962a3c76cf8f; no voters:
I20260807 10:48:18.801594 8346 raft_consensus.cc:2781] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:48:18.801756 8346 raft_consensus.cc:482] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:48:18.801875 8346 raft_consensus.cc:3037] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:18.804313 8346 raft_consensus.cc:504] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 } } peers { permanent_uuid: "f1e701d5cde9497083e9962a3c76cf8f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 33317 } } peers { permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 } }
I20260807 10:48:18.804987 8346 leader_election.cc:288] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [CANDIDATE]: Term 1 election: Requested vote from peers bdd8ce7819a74b2c841e0373f4e96a80 (127.11.46.129:33307), 415a01ec338e429694bca7bf6c87557e (127.11.46.131:40029)
I20260807 10:48:18.805678 7873 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a2e05fa48df458c910369d24f68525d" candidate_uuid: "f1e701d5cde9497083e9962a3c76cf8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdd8ce7819a74b2c841e0373f4e96a80"
I20260807 10:48:18.805707 8242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a2e05fa48df458c910369d24f68525d" candidate_uuid: "f1e701d5cde9497083e9962a3c76cf8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "415a01ec338e429694bca7bf6c87557e"
I20260807 10:48:18.805935 8242 raft_consensus.cc:3037] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:18.805914 7873 raft_consensus.cc:3037] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:18.808403 7873 raft_consensus.cc:2454] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1e701d5cde9497083e9962a3c76cf8f in term 1.
I20260807 10:48:18.808413 8242 raft_consensus.cc:2454] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1e701d5cde9497083e9962a3c76cf8f in term 1.
I20260807 10:48:18.808925 7968 leader_election.cc:302] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bdd8ce7819a74b2c841e0373f4e96a80, f1e701d5cde9497083e9962a3c76cf8f; no voters:
I20260807 10:48:18.809263 8346 raft_consensus.cc:2781] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:18.809793 8346 raft_consensus.cc:686] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 1 LEADER]: Becoming Leader. State: Replica: f1e701d5cde9497083e9962a3c76cf8f, State: Running, Role: LEADER
I20260807 10:48:18.810338 8346 consensus_queue.cc:237] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 } } peers { permanent_uuid: "f1e701d5cde9497083e9962a3c76cf8f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 33317 } } peers { permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 } }
W20260807 10:48:18.814209 8310 tablet.cc:2369] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:48:18.816064 7671 catalog_manager.cc:5495] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f reported cstate change: term changed from 0 to 1, leader changed from <none> to f1e701d5cde9497083e9962a3c76cf8f (127.11.46.130). New cstate: current_term: 1 leader_uuid: "f1e701d5cde9497083e9962a3c76cf8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1e701d5cde9497083e9962a3c76cf8f" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 33317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 } health_report { overall_health: UNKNOWN } } }
W20260807 10:48:18.836616 7940 tablet.cc:2369] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:48:18.849679 8333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.844297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54428 (local address 127.11.46.130:33317)
0807 10:48:18.844498 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:18.844503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:18.844596 (+ 93us) server_negotiation.cc:407] Connection header received
0807 10:48:18.844784 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:18.844788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:18.844882 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:18.845024 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:48:18.845346 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.846152 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.847528 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.847942 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.848040 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.848500 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:48:18.849094 (+ 594us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:48:18.849216 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:18.849261 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 10:48:18.849367 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 10:48:18.858804 8242 raft_consensus.cc:1261] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e [term 1 FOLLOWER]: Refusing update from remote peer f1e701d5cde9497083e9962a3c76cf8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:48:18.858803 7873 raft_consensus.cc:1261] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80 [term 1 FOLLOWER]: Refusing update from remote peer f1e701d5cde9497083e9962a3c76cf8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:48:18.859928 8353 consensus_queue.cc:1035] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "415a01ec338e429694bca7bf6c87557e" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 40029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:48:18.860304 8346 consensus_queue.cc:1035] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdd8ce7819a74b2c841e0373f4e96a80" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 33307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:48:18.875478 8357 mvcc.cc:205] Tried to move back new op lower bound from 7315864366514491392 to 7315864366331650048. Current Snapshot: MvccSnapshot[applied={T|T < 7315864366514491392}]
I20260807 10:48:18.876639 8359 mvcc.cc:205] Tried to move back new op lower bound from 7315864366514491392 to 7315864366331650048. Current Snapshot: MvccSnapshot[applied={T|T < 7315864366514491392}]
I20260807 10:48:18.891326 7671 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:48:18.891628 7671 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:48:18.895722 7671 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b7f28ffba9034843bd5a28bbe5de9cda: Sending DeleteTablet for 3 replicas of tablet 2a2e05fa48df458c910369d24f68525d
I20260807 10:48:18.897269 7844 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a2e05fa48df458c910369d24f68525d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:18 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:49094
I20260807 10:48:18.897267 8034 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a2e05fa48df458c910369d24f68525d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:18 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:54416
I20260807 10:48:18.897372 8214 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a2e05fa48df458c910369d24f68525d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:18 UTC) from {username='kudu', principal='kudu/127.11.46.190@KRBTEST.COM'} at 127.0.0.1:50688
I20260807 10:48:18.901427 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 7759
I20260807 10:48:18.908669 8374 tablet_replica.cc:330] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: stopping tablet replica
I20260807 10:48:18.909610 8374 raft_consensus.cc:2229] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:48:18.910676 8374 raft_consensus.cc:2258] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:18.912027 8372 tablet_replica.cc:330] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: stopping tablet replica
I20260807 10:48:18.914042 8374 ts_tablet_manager.cc:1905] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:18.914775 8373 tablet_replica.cc:330] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: stopping tablet replica
I20260807 10:48:18.915031 8372 raft_consensus.cc:2229] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:48:18.915828 8372 raft_consensus.cc:2258] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:18.916658 8373 raft_consensus.cc:2229] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:48:18.917284 8373 raft_consensus.cc:2258] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:18.918318 8372 ts_tablet_manager.cc:1905] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 10:48:18 dist-test-slave-42z9 krb5kdc[7600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.129@KRBTEST.COM
I20260807 10:48:18.925505 8374 ts_tablet_manager.cc:1918] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:48:18.925930 8374 log.cc:1196] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/2a2e05fa48df458c910369d24f68525d
I20260807 10:48:18.926839 8372 ts_tablet_manager.cc:1918] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:48:18.927352 8372 log.cc:1196] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-0/wal/wals/2a2e05fa48df458c910369d24f68525d
I20260807 10:48:18.927821 8373 ts_tablet_manager.cc:1905] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:18.928025 8372 ts_tablet_manager.cc:1939] T 2a2e05fa48df458c910369d24f68525d P bdd8ce7819a74b2c841e0373f4e96a80: Deleting consensus metadata
I20260807 10:48:18.930377 7641 catalog_manager.cc:4841] TS bdd8ce7819a74b2c841e0373f4e96a80 (127.11.46.129:33307): tablet 2a2e05fa48df458c910369d24f68525d (table test-table [id=7bfeac3755c3476db9ae2b24ba763f72]) successfully deleted
I20260807 10:48:18.932214 8374 ts_tablet_manager.cc:1939] T 2a2e05fa48df458c910369d24f68525d P f1e701d5cde9497083e9962a3c76cf8f: Deleting consensus metadata
I20260807 10:48:18.934417 8331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:18.905149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49108 (local address 127.11.46.129:33307)
0807 10:48:18.905364 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:18.905372 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:18.907264 (+ 1892us) server_negotiation.cc:407] Connection header received
0807 10:48:18.907509 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:18.907515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:18.907619 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:18.907741 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:18.914134 (+ 6393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.915376 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.917657 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:18.918365 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:18.918505 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:18.924782 (+ 6277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:18.924807 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:18.924833 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:18.924900 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:18.929189 (+ 4289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:18.931156 (+ 1967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:18.931169 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:18.931173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:18.931366 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:18.932000 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:18.932006 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:18.932009 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:18.932645 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:18.932974 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:18.933701 (+ 727us) server_negotiation.cc:299] Negotiation successful
0807 10:48:18.933992 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:48:18.934583 7650 catalog_manager.cc:4841] TS f1e701d5cde9497083e9962a3c76cf8f (127.11.46.130:33317): tablet 2a2e05fa48df458c910369d24f68525d (table test-table [id=7bfeac3755c3476db9ae2b24ba763f72]) successfully deleted
I20260807 10:48:18.935057 8373 ts_tablet_manager.cc:1918] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:48:18.935266 8373 log.cc:1196] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/2a2e05fa48df458c910369d24f68525d
I20260807 10:48:18.935742 8373 ts_tablet_manager.cc:1939] T 2a2e05fa48df458c910369d24f68525d P 415a01ec338e429694bca7bf6c87557e: Deleting consensus metadata
I20260807 10:48:18.936371 7929 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:18.937651 7641 catalog_manager.cc:4841] TS 415a01ec338e429694bca7bf6c87557e (127.11.46.131:40029): tablet 2a2e05fa48df458c910369d24f68525d (table test-table [id=7bfeac3755c3476db9ae2b24ba763f72]) successfully deleted
I20260807 10:48:19.030514 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 7759
I20260807 10:48:19.076202 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 7950
Aug 07 10:48:19 dist-test-slave-42z9 krb5kdc[7600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.130@KRBTEST.COM
I20260807 10:48:19.094290 8333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:19.077190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54444 (local address 127.11.46.130:33317)
0807 10:48:19.077470 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:19.077477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:19.077497 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:48:19.077565 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:19.077569 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:19.077685 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:19.077790 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:19.079187 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:19.080217 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:19.081867 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:19.082380 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:19.082528 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:19.087589 (+ 5061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:19.087610 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:19.087630 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:19.087679 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:19.091134 (+ 3455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:19.091969 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:19.091981 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:19.091984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:19.092167 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:19.092566 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:19.092570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:19.092572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:19.092981 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:19.093370 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:19.093644 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 10:48:19.093893 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:48:19.095089 8120 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:19.218818 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 7950
I20260807 10:48:19.248732 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 8135
Aug 07 10:48:19 dist-test-slave-42z9 krb5kdc[7600](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.131@KRBTEST.COM
I20260807 10:48:19.265333 8336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:19.249600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50702 (local address 127.11.46.131:40029)
0807 10:48:19.249828 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:19.249834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:19.249856 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:48:19.249919 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:19.249923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:19.249998 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:19.250094 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:19.251434 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:19.252184 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:19.253596 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:19.254017 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:19.254124 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:19.258798 (+ 4674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:19.258818 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:19.258837 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:19.258884 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:19.262117 (+ 3233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:19.262993 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:19.263005 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:19.263008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:19.263175 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:19.263607 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:19.263612 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:19.263614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:19.264048 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:19.264362 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:19.264697 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 10:48:19.264949 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 10:48:19.266083 8301 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:19.359618 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 8135
I20260807 10:48:19.386768 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 7618
I20260807 10:48:19.387868 7710 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:19.503265 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 7618
2026-08-07T10:48:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5096 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T10:48:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:19Z Disabled control of system clock
I20260807 10:48:19.625041 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:33369
--webserver_interface=127.11.46.190
--webserver_port=0
--builtin_ntp_servers=127.11.46.148:37007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:33369
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:48:20.017540 8387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:20.017897 8387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:20.017997 8387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:20.026000 8387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:20.026136 8387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:20.026196 8387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:20.026279 8387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:20.026336 8387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:20.036597 8387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:37007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:33369
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:33369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:20.038193 8387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:20.040390 8387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:20.053776 8396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:20.053814 8400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:20.053861 8397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:20.054957 8387 server_base.cc:1034] running on GCE node
I20260807 10:48:20.055923 8387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:20.057687 8387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:20.058934 8387 hybrid_clock.cc:648] HybridClock initialized: now 1786099700058876 us; error 51 us; skew 500 ppm
I20260807 10:48:20.059412 8387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:20.062177 8387 webserver.cc:460] Webserver started at http://127.11.46.190:33113/ using document root <none> and password file <none>
I20260807 10:48:20.063002 8387 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:20.063117 8387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:20.063483 8387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:20.066807 8387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "64e1ff99601f4f3ab1a12719210a0b58"
format_stamp: "Formatted at 2026-08-07 10:48:20 on dist-test-slave-42z9"
server_key: "a740a82a92f92c052ebdd449f51fdb2b"
server_key_iv: "78269eb1bb7586900a81973d8f938363"
server_key_version: "encryptionkey@0"
I20260807 10:48:20.067718 8387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "64e1ff99601f4f3ab1a12719210a0b58"
format_stamp: "Formatted at 2026-08-07 10:48:20 on dist-test-slave-42z9"
server_key: "a740a82a92f92c052ebdd449f51fdb2b"
server_key_iv: "78269eb1bb7586900a81973d8f938363"
server_key_version: "encryptionkey@0"
I20260807 10:48:20.073417 8387 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 10:48:20.077569 8407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:20.079403 8387 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260807 10:48:20.079591 8387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "64e1ff99601f4f3ab1a12719210a0b58"
format_stamp: "Formatted at 2026-08-07 10:48:20 on dist-test-slave-42z9"
server_key: "a740a82a92f92c052ebdd449f51fdb2b"
server_key_iv: "78269eb1bb7586900a81973d8f938363"
server_key_version: "encryptionkey@0"
I20260807 10:48:20.079805 8387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:20.101855 8387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:20.102885 8387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:20.103179 8387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:20.123417 8387 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:33369
I20260807 10:48:20.123432 8475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:33369 every 8 connection(s)
I20260807 10:48:20.124985 8387 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:20.126814 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 8387
I20260807 10:48:20.127013 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:20.127578 11450 external_mini_cluster.cc:1428] Setting key 8d6a8200b8d3062f0497fe63df35f101
I20260807 10:48:20.130560 8476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:20.142200 8481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:20.129882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46634 (local address 127.11.46.190:33369)
0807 10:48:20.131053 (+ 1171us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:20.131064 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:20.131110 (+ 46us) server_negotiation.cc:407] Connection header received
0807 10:48:20.132820 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:20.132845 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:20.133340 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:20.133838 (+ 498us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:20.134451 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:20.135881 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:20.137341 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:20.138148 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:20.138337 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:20.139578 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:20.139587 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:20.139608 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:20.140253 (+ 645us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:20.140346 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:20.140380 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:20.140499 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:20.140743 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 10:48:20.141084 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":415,"threads_started":1}
I20260807 10:48:20.142628 8476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58: Bootstrap starting.
I20260807 10:48:20.146224 8476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:20.147356 8476 log.cc:824] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:20.150633 8476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58: No bootstrap required, opened a new log
I20260807 10:48:20.159190 8476 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e1ff99601f4f3ab1a12719210a0b58" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33369 } }
I20260807 10:48:20.159673 8476 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:20.159761 8476 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e1ff99601f4f3ab1a12719210a0b58, State: Initialized, Role: FOLLOWER
I20260807 10:48:20.160408 8476 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e1ff99601f4f3ab1a12719210a0b58" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33369 } }
I20260807 10:48:20.160653 8476 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:20.160768 8476 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:20.160915 8476 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:20.163589 8476 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e1ff99601f4f3ab1a12719210a0b58" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33369 } }
I20260807 10:48:20.164337 8476 leader_election.cc:302] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64e1ff99601f4f3ab1a12719210a0b58; no voters:
I20260807 10:48:20.165025 8476 leader_election.cc:288] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:20.165186 8483 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:20.165988 8483 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [term 1 LEADER]: Becoming Leader. State: Replica: 64e1ff99601f4f3ab1a12719210a0b58, State: Running, Role: LEADER
I20260807 10:48:20.166591 8483 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e1ff99601f4f3ab1a12719210a0b58" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33369 } }
I20260807 10:48:20.167383 8476 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:20.169984 8486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64e1ff99601f4f3ab1a12719210a0b58. Latest consensus state: current_term: 1 leader_uuid: "64e1ff99601f4f3ab1a12719210a0b58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e1ff99601f4f3ab1a12719210a0b58" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33369 } } }
I20260807 10:48:20.170461 8486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:20.171398 8484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64e1ff99601f4f3ab1a12719210a0b58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e1ff99601f4f3ab1a12719210a0b58" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33369 } } }
I20260807 10:48:20.172112 8484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:20.173699 8495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:20.180276 8495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:20.190706 8495 catalog_manager.cc:1347] Generated new cluster ID: 22499e8232be4cd4afb739d40ec29524
I20260807 10:48:20.190855 8495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:20.201546 8495 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:20.203118 8495 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:20.217567 8495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58: Generated new TSK 0
I20260807 10:48:20.218933 8495 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:20.231531 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.129:0
--local_ip_for_outbound_sockets=127.11.46.129
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:33369
--builtin_ntp_servers=127.11.46.148:37007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 10:48:20.633952 8514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:20.634284 8514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:20.634387 8514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:20.642249 8514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:20.642376 8514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:20.642500 8514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.129
I20260807 10:48:20.652410 8514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:37007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.46.129
--webserver_port=0
--tserver_master_addrs=127.11.46.190:33369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.129
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:20.653846 8514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:20.655750 8514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:20.669945 8524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:20.670051 8529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:20.669970 8523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:20.670957 8514 server_base.cc:1034] running on GCE node
I20260807 10:48:20.671689 8514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:20.672909 8514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:20.674115 8514 hybrid_clock.cc:648] HybridClock initialized: now 1786099700674048 us; error 62 us; skew 500 ppm
I20260807 10:48:20.674506 8514 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:20.677105 8514 webserver.cc:460] Webserver started at http://127.11.46.129:42693/ using document root <none> and password file <none>
I20260807 10:48:20.678025 8514 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:20.678151 8514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:20.678524 8514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:20.682020 8514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/data/instance:
uuid: "fe6b8d892ade4658871733f69f3a588e"
format_stamp: "Formatted at 2026-08-07 10:48:20 on dist-test-slave-42z9"
server_key: "7a926110323922df1df9ed06d664bdaa"
server_key_iv: "3ad28fe9d20f14bf1ef64080b40cf168"
server_key_version: "encryptionkey@0"
I20260807 10:48:20.683043 8514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance:
uuid: "fe6b8d892ade4658871733f69f3a588e"
format_stamp: "Formatted at 2026-08-07 10:48:20 on dist-test-slave-42z9"
server_key: "7a926110323922df1df9ed06d664bdaa"
server_key_iv: "3ad28fe9d20f14bf1ef64080b40cf168"
server_key_version: "encryptionkey@0"
I20260807 10:48:20.689380 8514 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:48:20.693461 8538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:20.694994 8514 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:48:20.695189 8514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/wal
uuid: "fe6b8d892ade4658871733f69f3a588e"
format_stamp: "Formatted at 2026-08-07 10:48:20 on dist-test-slave-42z9"
server_key: "7a926110323922df1df9ed06d664bdaa"
server_key_iv: "3ad28fe9d20f14bf1ef64080b40cf168"
server_key_version: "encryptionkey@0"
I20260807 10:48:20.695462 8514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:20.717152 8514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:20.718272 8514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:20.718616 8514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:20.719776 8514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:20.721499 8514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:20.721609 8514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 10:48:20.721719 8514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:20.721791 8514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:20.766693 8514 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.129:42357
I20260807 10:48:20.766810 8689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.129:42357 every 8 connection(s)
I20260807 10:48:20.768734 8514 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/data/info.pb
I20260807 10:48:20.776407 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 8514
I20260807 10:48:20.776572 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-0/wal/instance
I20260807 10:48:20.777024 11450 external_mini_cluster.cc:1428] Setting key 50b84b3a181308f537d3c72cfc4e9780
I20260807 10:48:20.780633 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.130:0
--local_ip_for_outbound_sockets=127.11.46.130
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:33369
--builtin_ntp_servers=127.11.46.148:37007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:48:20.786936 8693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:20.773640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.129:41771 (local address 127.11.46.190:33369)
0807 10:48:20.774218 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:20.774225 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:20.775664 (+ 1439us) server_negotiation.cc:407] Connection header received
0807 10:48:20.778266 (+ 2602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:20.778273 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:20.778391 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:20.778511 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:20.780212 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:20.781346 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:20.783231 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:20.783910 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:20.784059 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:20.785955 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:20.785960 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:20.785964 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:20.785990 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:20.786038 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:20.786052 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:20.786136 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:20.786429 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 10:48:20.786554 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":274,"threads_started":1}
I20260807 10:48:20.788436 8694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:20.774347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:33369 (local address 127.11.46.129:41771)
0807 10:48:20.775468 (+ 1121us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:20.775510 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:20.777530 (+ 2020us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:20.778878 (+ 1348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:20.778892 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:20.779042 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:20.780000 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:20.780029 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:20.781585 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:20.781591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:20.783054 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:20.783076 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:20.784213 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:20.784222 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:20.784576 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:20.785428 (+ 852us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:48:20.785431 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:20.785544 (+ 113us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:48:20.785691 (+ 147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:20.786160 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:20.786174 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:20.786183 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 10:48:20.786408 (+ 225us) client_negotiation.cc:240] Negotiation successful
0807 10:48:20.786930 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":349,"threads_started":1}
I20260807 10:48:20.790395 8690 heartbeater.cc:347] Connected to a master server at 127.11.46.190:33369
I20260807 10:48:20.790786 8690 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:20.791746 8690 heartbeater.cc:511] Master 127.11.46.190:33369 requested a full tablet report, sending...
I20260807 10:48:20.794603 8433 ts_manager.cc:194] Registered new tserver with Master: fe6b8d892ade4658871733f69f3a588e (127.11.46.129:42357)
I20260807 10:48:20.796808 8433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.129:41771
W20260807 10:48:21.171459 8696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:21.171823 8696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:21.171980 8696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:21.180092 8696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:21.180250 8696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:21.180413 8696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.130
I20260807 10:48:21.190546 8696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:37007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.46.130
--webserver_port=0
--tserver_master_addrs=127.11.46.190:33369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.130
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:21.192065 8696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:21.194309 8696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:21.208994 8704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:21.209034 8710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:21.208952 8707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:21.210310 8696 server_base.cc:1034] running on GCE node
I20260807 10:48:21.211100 8696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:21.212301 8696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:21.213600 8696 hybrid_clock.cc:648] HybridClock initialized: now 1786099701213528 us; error 59 us; skew 500 ppm
I20260807 10:48:21.214015 8696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:21.216768 8696 webserver.cc:460] Webserver started at http://127.11.46.130:42767/ using document root <none> and password file <none>
I20260807 10:48:21.217644 8696 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:21.217774 8696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:21.218127 8696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:21.221680 8696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/data/instance:
uuid: "217efb3bfd904a04a56e89c508ef72bd"
format_stamp: "Formatted at 2026-08-07 10:48:21 on dist-test-slave-42z9"
server_key: "3a80dc8023df45fa8895ce1441f67e40"
server_key_iv: "6482f80d973e843dc365d5ff1891f6e4"
server_key_version: "encryptionkey@0"
I20260807 10:48:21.222618 8696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance:
uuid: "217efb3bfd904a04a56e89c508ef72bd"
format_stamp: "Formatted at 2026-08-07 10:48:21 on dist-test-slave-42z9"
server_key: "3a80dc8023df45fa8895ce1441f67e40"
server_key_iv: "6482f80d973e843dc365d5ff1891f6e4"
server_key_version: "encryptionkey@0"
I20260807 10:48:21.228839 8696 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:48:21.233263 8717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:21.234931 8696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:48:21.235157 8696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/wal
uuid: "217efb3bfd904a04a56e89c508ef72bd"
format_stamp: "Formatted at 2026-08-07 10:48:21 on dist-test-slave-42z9"
server_key: "3a80dc8023df45fa8895ce1441f67e40"
server_key_iv: "6482f80d973e843dc365d5ff1891f6e4"
server_key_version: "encryptionkey@0"
I20260807 10:48:21.235420 8696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:21.285400 8696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:21.286476 8696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:21.286808 8696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:21.288051 8696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:21.289945 8696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:21.290069 8696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:21.290199 8696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:21.290271 8696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:21.324954 8696 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.130:32881
I20260807 10:48:21.325001 8868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.130:32881 every 8 connection(s)
I20260807 10:48:21.326474 8696 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/data/info.pb
I20260807 10:48:21.334364 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 8696
I20260807 10:48:21.334579 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/wal/instance
I20260807 10:48:21.335162 11450 external_mini_cluster.cc:1428] Setting key 10aaf6aa09f56fd0a2bfe43e6bdc546a
I20260807 10:48:21.338366 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.46.131:0
--local_ip_for_outbound_sockets=127.11.46.131
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:33369
--builtin_ntp_servers=127.11.46.148:37007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 10:48:21.340843 8878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.329303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:51265 (local address 127.11.46.190:33369)
0807 10:48:21.329804 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:21.329808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:21.331077 (+ 1269us) server_negotiation.cc:407] Connection header received
0807 10:48:21.333046 (+ 1969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:21.333052 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:21.333155 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:21.333261 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:21.334901 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.335735 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.337593 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.338023 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.338136 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.339969 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:21.339975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:21.339978 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:21.340001 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:21.340057 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:21.340074 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:21.340242 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:21.340427 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 10:48:21.340559 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":269,"threads_started":1}
I20260807 10:48:21.342434 8879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.329909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:33369 (local address 127.11.46.130:51265)
0807 10:48:21.330891 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:21.330939 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:21.332710 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:21.333602 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:21.333612 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:21.333715 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:21.334664 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.334698 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.335944 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.335950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.337395 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.337416 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.338312 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.338321 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.338704 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.339540 (+ 836us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:48:21.339543 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:21.339609 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:48:21.339731 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:21.340184 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:21.340197 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:21.340206 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 10:48:21.340403 (+ 197us) client_negotiation.cc:240] Negotiation successful
0807 10:48:21.340898 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":292,"threads_started":1}
I20260807 10:48:21.344134 8871 heartbeater.cc:347] Connected to a master server at 127.11.46.190:33369
I20260807 10:48:21.344509 8871 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:21.345420 8871 heartbeater.cc:511] Master 127.11.46.190:33369 requested a full tablet report, sending...
I20260807 10:48:21.347163 8433 ts_manager.cc:194] Registered new tserver with Master: 217efb3bfd904a04a56e89c508ef72bd (127.11.46.130:32881)
I20260807 10:48:21.348039 8433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.130:51265
W20260807 10:48:21.726454 8880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:21.726801 8880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:21.726924 8880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:21.734707 8880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:21.734845 8880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:21.734993 8880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.46.131
I20260807 10:48:21.744895 8880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:37007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.46.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.46.131
--webserver_port=0
--tserver_master_addrs=127.11.46.190:33369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.46.131
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:21.746450 8880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:21.748529 8880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:21.763062 8886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:21.762979 8889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:21.763015 8885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:21.763917 8880 server_base.cc:1034] running on GCE node
I20260807 10:48:21.764703 8880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:21.765930 8880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:21.767175 8880 hybrid_clock.cc:648] HybridClock initialized: now 1786099701767093 us; error 71 us; skew 500 ppm
I20260807 10:48:21.767560 8880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 10:48:21.773407 8880 webserver.cc:460] Webserver started at http://127.11.46.131:40987/ using document root <none> and password file <none>
I20260807 10:48:21.774269 8880 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:21.774415 8880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:21.774749 8880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:21.777966 8880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/data/instance:
uuid: "df392badf9664056adda9c62c0130e49"
format_stamp: "Formatted at 2026-08-07 10:48:21 on dist-test-slave-42z9"
server_key: "63cf3a4ce508266387a11ad5afa67576"
server_key_iv: "cffda815ff55c0a98d283405884f27df"
server_key_version: "encryptionkey@0"
I20260807 10:48:21.778843 8880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance:
uuid: "df392badf9664056adda9c62c0130e49"
format_stamp: "Formatted at 2026-08-07 10:48:21 on dist-test-slave-42z9"
server_key: "63cf3a4ce508266387a11ad5afa67576"
server_key_iv: "cffda815ff55c0a98d283405884f27df"
server_key_version: "encryptionkey@0"
I20260807 10:48:21.784775 8880 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:48:21.788816 8901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:21.790459 8880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 10:48:21.790654 8880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/wal
uuid: "df392badf9664056adda9c62c0130e49"
format_stamp: "Formatted at 2026-08-07 10:48:21 on dist-test-slave-42z9"
server_key: "63cf3a4ce508266387a11ad5afa67576"
server_key_iv: "cffda815ff55c0a98d283405884f27df"
server_key_version: "encryptionkey@0"
I20260807 10:48:21.790897 8880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:21.800943 8690 heartbeater.cc:503] Master 127.11.46.190:33369 was elected leader, sending a full tablet report...
I20260807 10:48:21.808372 8880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:21.809276 8880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:21.809619 8880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:21.810667 8880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 10:48:21.812206 8880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 10:48:21.812296 8880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:21.812386 8880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 10:48:21.812438 8880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:21.844930 8880 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.131:39419
I20260807 10:48:21.844964 9061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.131:39419 every 8 connection(s)
I20260807 10:48:21.846472 8880 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/data/info.pb
I20260807 10:48:21.849045 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 8880
I20260807 10:48:21.849259 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/wal/instance
I20260807 10:48:21.849893 11450 external_mini_cluster.cc:1428] Setting key 49e51066cf220c49ad8b30ff858c5f5c
I20260807 10:48:21.860296 9066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.849413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.131:46989 (local address 127.11.46.190:33369)
0807 10:48:21.849884 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:21.849889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:21.851938 (+ 2049us) server_negotiation.cc:407] Connection header received
0807 10:48:21.853711 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:21.853715 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:21.853796 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:21.853881 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:21.855005 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.855786 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.857495 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.857952 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.858076 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.859557 (+ 1481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:21.859562 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:21.859565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:21.859588 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:21.859638 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:21.859650 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:21.859718 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:21.859911 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 10:48:21.860003 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":217,"threads_started":1}
I20260807 10:48:21.861377 9068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.850276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:33369 (local address 127.11.46.131:46989)
0807 10:48:21.851488 (+ 1212us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:21.851560 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:21.853370 (+ 1810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:21.854107 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:21.854116 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:21.854215 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:48:21.854864 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.854882 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.855919 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.855923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.857254 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.857272 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.858184 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.858190 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.858428 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.859188 (+ 760us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 10:48:21.859191 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:48:21.859238 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 10:48:21.859331 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:48:21.859729 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:48:21.859737 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:48:21.859744 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 10:48:21.859897 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 10:48:21.860254 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":362,"threads_started":1}
I20260807 10:48:21.862843 9064 heartbeater.cc:347] Connected to a master server at 127.11.46.190:33369
I20260807 10:48:21.863204 9064 heartbeater.cc:464] Registering TS with master...
I20260807 10:48:21.864310 9064 heartbeater.cc:511] Master 127.11.46.190:33369 requested a full tablet report, sending...
I20260807 10:48:21.865923 8433 ts_manager.cc:194] Registered new tserver with Master: df392badf9664056adda9c62c0130e49 (127.11.46.131:39419)
I20260807 10:48:21.866869 8433 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.46.131:46989
I20260807 10:48:21.877866 11450 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 10:48:21.887977 9066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.882222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46644 (local address 127.11.46.190:33369)
0807 10:48:21.882401 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:21.882405 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:21.882856 (+ 451us) server_negotiation.cc:407] Connection header received
0807 10:48:21.883008 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:21.883012 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:21.883077 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:21.883160 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:21.883649 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.884429 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.885835 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.886252 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.886353 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.887376 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:21.887380 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:21.887383 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:21.887404 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:21.887446 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:21.887458 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:21.887525 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:21.887630 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 10:48:21.887718 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 10:48:21.892225 8433 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46644:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 10:48:21.899565 8433 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 10:48:21.924476 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.912904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.130:32881 (local address 127.0.0.1:51694)
0807 10:48:21.913850 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:21.913910 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:21.914116 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:21.915465 (+ 1349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:21.915475 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:21.915513 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:21.916003 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.916027 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.918415 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.918422 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.921091 (+ 2669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.921114 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.923415 (+ 2301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.923423 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.923672 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.923735 (+ 63us) client_negotiation.cc:769] Sending connection context
0807 10:48:21.923860 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 10:48:21.924089 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":368,"threads_started":1}
I20260807 10:48:21.926216 9088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.913064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51694 (local address 127.11.46.130:32881)
0807 10:48:21.914688 (+ 1624us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:21.914699 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:21.914736 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:48:21.914855 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:21.914864 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:21.915173 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:21.916262 (+ 1089us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:21.916528 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.918233 (+ 1705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.921416 (+ 3183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.923113 (+ 1697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.925153 (+ 2040us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.925530 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:21.925619 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 10:48:21.925834 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1455,"thread_start_us":1358,"threads_started":1}
I20260807 10:48:21.931593 8778 tablet_service.cc:1467] Processing CreateTablet for tablet 3cd5af48e9a4492ca02271faf5d6cb3a (DEFAULT_TABLE table=test-table [id=ff536e070b6b47a3b929d3b58301095e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:21.933185 8778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cd5af48e9a4492ca02271faf5d6cb3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:21.934785 9090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.914239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:39419 (local address 127.0.0.1:49592)
0807 10:48:21.926817 (+ 12578us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:21.926839 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:21.926971 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:21.928099 (+ 1128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:21.928103 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:21.928131 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:21.928492 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.928505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.930367 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.930373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.932470 (+ 2097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.932482 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.933896 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.933904 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.934088 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.934123 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 10:48:21.934216 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 10:48:21.934362 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12005,"mutex_wait_us":3,"thread_start_us":12439,"threads_started":1}
I20260807 10:48:21.934805 9093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.914884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49592 (local address 127.11.46.131:39419)
0807 10:48:21.924155 (+ 9271us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:21.924163 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:21.927126 (+ 2963us) server_negotiation.cc:407] Connection header received
0807 10:48:21.927248 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:21.927256 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:21.927569 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:21.927784 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:21.928715 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.930212 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.932664 (+ 2452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.933693 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.933823 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.934127 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:21.934279 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 10:48:21.934445 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9063,"thread_start_us":8901,"threads_started":1}
I20260807 10:48:21.936018 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.913814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:42357 (local address 127.0.0.1:34380)
0807 10:48:21.924793 (+ 10979us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:21.924816 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:21.924944 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:21.927926 (+ 2982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:21.927930 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:21.927959 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:21.928147 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.928159 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.930064 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.930070 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.932002 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.932020 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.935206 (+ 3186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.935212 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.935415 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.935449 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 10:48:21.935559 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 10:48:21.935703 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10848,"mutex_wait_us":2,"thread_start_us":12610,"threads_started":1}
I20260807 10:48:21.936170 9091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.913971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34380 (local address 127.11.46.129:42357)
0807 10:48:21.927330 (+ 13359us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:21.927337 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:21.927363 (+ 26us) server_negotiation.cc:407] Connection header received
0807 10:48:21.927448 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:21.927453 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:21.927665 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:21.927938 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:21.928341 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.929890 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.932198 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.933656 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.935175 (+ 1519us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.935453 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:21.935615 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 10:48:21.935793 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13184,"thread_start_us":13053,"threads_started":1}
I20260807 10:48:21.939658 8596 tablet_service.cc:1467] Processing CreateTablet for tablet 3cd5af48e9a4492ca02271faf5d6cb3a (DEFAULT_TABLE table=test-table [id=ff536e070b6b47a3b929d3b58301095e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:21.939558 8960 tablet_service.cc:1467] Processing CreateTablet for tablet 3cd5af48e9a4492ca02271faf5d6cb3a (DEFAULT_TABLE table=test-table [id=ff536e070b6b47a3b929d3b58301095e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 10:48:21.941257 8960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cd5af48e9a4492ca02271faf5d6cb3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:21.941265 8596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cd5af48e9a4492ca02271faf5d6cb3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:21.947199 9094 tablet_bootstrap.cc:492] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: Bootstrap starting.
I20260807 10:48:21.951166 9094 tablet_bootstrap.cc:654] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:21.952297 9094 log.cc:824] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:21.955193 9094 tablet_bootstrap.cc:492] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: No bootstrap required, opened a new log
I20260807 10:48:21.955484 9094 ts_tablet_manager.cc:1397] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 10:48:21.958231 9099 tablet_bootstrap.cc:492] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: Bootstrap starting.
I20260807 10:48:21.958685 9098 tablet_bootstrap.cc:492] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e: Bootstrap starting.
I20260807 10:48:21.961551 9099 tablet_bootstrap.cc:654] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:21.962307 9098 tablet_bootstrap.cc:654] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:21.962638 9099 log.cc:824] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:21.963488 9098 log.cc:824] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:21.965736 9099 tablet_bootstrap.cc:492] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: No bootstrap required, opened a new log
I20260807 10:48:21.966017 9099 ts_tablet_manager.cc:1397] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.003s
I20260807 10:48:21.966872 9098 tablet_bootstrap.cc:492] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e: No bootstrap required, opened a new log
I20260807 10:48:21.967064 9094 raft_consensus.cc:348] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "217efb3bfd904a04a56e89c508ef72bd" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32881 } } peers { permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 } } peers { permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 } }
I20260807 10:48:21.967532 9094 raft_consensus.cc:374] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:21.967635 9094 raft_consensus.cc:729] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 217efb3bfd904a04a56e89c508ef72bd, State: Initialized, Role: FOLLOWER
I20260807 10:48:21.968029 9098 ts_tablet_manager.cc:1397] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260807 10:48:21.968331 9094 consensus_queue.cc:260] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "217efb3bfd904a04a56e89c508ef72bd" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32881 } } peers { permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 } } peers { permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 } }
I20260807 10:48:21.974351 8871 heartbeater.cc:503] Master 127.11.46.190:33369 was elected leader, sending a full tablet report...
I20260807 10:48:21.973803 9099 raft_consensus.cc:348] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "217efb3bfd904a04a56e89c508ef72bd" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32881 } } peers { permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 } } peers { permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 } }
I20260807 10:48:21.975061 9099 raft_consensus.cc:374] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:21.975358 9094 ts_tablet_manager.cc:1428] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: Time spent starting tablet: real 0.020s user 0.010s sys 0.010s
I20260807 10:48:21.975634 9103 raft_consensus.cc:482] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 10:48:21.975945 9099 raft_consensus.cc:729] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df392badf9664056adda9c62c0130e49, State: Initialized, Role: FOLLOWER
I20260807 10:48:21.975970 9103 raft_consensus.cc:504] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "217efb3bfd904a04a56e89c508ef72bd" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32881 } } peers { permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 } } peers { permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 } }
I20260807 10:48:21.976809 9099 consensus_queue.cc:260] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "217efb3bfd904a04a56e89c508ef72bd" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32881 } } peers { permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 } } peers { permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 } }
I20260807 10:48:21.981218 9098 raft_consensus.cc:348] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "217efb3bfd904a04a56e89c508ef72bd" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32881 } } peers { permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 } } peers { permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 } }
I20260807 10:48:21.981815 9098 raft_consensus.cc:374] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:21.981932 9098 raft_consensus.cc:729] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6b8d892ade4658871733f69f3a588e, State: Initialized, Role: FOLLOWER
I20260807 10:48:21.982765 9098 consensus_queue.cc:260] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "217efb3bfd904a04a56e89c508ef72bd" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32881 } } peers { permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 } } peers { permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 } }
I20260807 10:48:21.986879 9064 heartbeater.cc:503] Master 127.11.46.190:33369 was elected leader, sending a full tablet report...
I20260807 10:48:21.987321 9099 ts_tablet_manager.cc:1428] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: Time spent starting tablet: real 0.021s user 0.016s sys 0.004s
I20260807 10:48:21.989872 9103 leader_election.cc:288] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df392badf9664056adda9c62c0130e49 (127.11.46.131:39419), fe6b8d892ade4658871733f69f3a588e (127.11.46.129:42357)
I20260807 10:48:21.990223 9098 ts_tablet_manager.cc:1428] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e: Time spent starting tablet: real 0.022s user 0.010s sys 0.008s
I20260807 10:48:21.993511 9093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.978683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:43903 (local address 127.11.46.131:39419)
0807 10:48:21.978914 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:21.978921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:21.983811 (+ 4890us) server_negotiation.cc:407] Connection header received
0807 10:48:21.984214 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:21.984219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:21.984303 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:21.984370 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:21.985308 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.986662 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.991074 (+ 4412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.992447 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.992610 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.992689 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:21.993083 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 10:48:21.993236 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:48:21.994326 9107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.978597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.131:39419 (local address 127.11.46.130:43903)
0807 10:48:21.983697 (+ 5100us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:21.983722 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:21.984022 (+ 300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:21.984654 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:21.984660 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:21.984692 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:21.985126 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.985138 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.986876 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.986882 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.990791 (+ 3909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.990813 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.992636 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.992643 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.992862 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:21.992898 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 10:48:21.993794 (+ 896us) client_negotiation.cc:240] Negotiation successful
0807 10:48:21.993956 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4931,"thread_start_us":4689,"threads_started":1}
I20260807 10:48:21.995539 8995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cd5af48e9a4492ca02271faf5d6cb3a" candidate_uuid: "217efb3bfd904a04a56e89c508ef72bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df392badf9664056adda9c62c0130e49" is_pre_election: true
I20260807 10:48:21.996191 8995 raft_consensus.cc:2454] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 217efb3bfd904a04a56e89c508ef72bd in term 0.
I20260807 10:48:21.996907 8722 leader_election.cc:302] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 217efb3bfd904a04a56e89c508ef72bd, df392badf9664056adda9c62c0130e49; no voters:
I20260807 10:48:21.997339 9103 raft_consensus.cc:2781] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 10:48:21.997581 9103 raft_consensus.cc:482] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 10:48:21.997715 9103 raft_consensus.cc:3037] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:22.000823 9103 raft_consensus.cc:504] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "217efb3bfd904a04a56e89c508ef72bd" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32881 } } peers { permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 } } peers { permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 } }
I20260807 10:48:22.001748 9091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.984569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.46.130:55225 (local address 127.11.46.129:42357)
0807 10:48:21.984769 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:21.984776 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:21.994644 (+ 9868us) server_negotiation.cc:407] Connection header received
0807 10:48:21.994850 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:21.994855 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:21.994960 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:21.995052 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 10:48:21.995716 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.996560 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.999799 (+ 3239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:22.000793 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:22.000931 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:22.000987 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:22.001368 (+ 381us) server_negotiation.cc:299] Negotiation successful
0807 10:48:22.001509 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 10:48:22.001811 9103 leader_election.cc:288] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [CANDIDATE]: Term 1 election: Requested vote from peers df392badf9664056adda9c62c0130e49 (127.11.46.131:39419), fe6b8d892ade4658871733f69f3a588e (127.11.46.129:42357)
I20260807 10:48:22.001864 9112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:21.984104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:42357 (local address 127.11.46.130:55225)
0807 10:48:21.994513 (+ 10409us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:21.994532 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:48:21.994682 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:48:21.995126 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:48:21.995131 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:48:21.995163 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 10:48:21.995541 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.995565 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:21.997357 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:21.997363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:21.999570 (+ 2207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:48:21.999587 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:48:22.001011 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:48:22.001018 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:48:22.001193 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:22.001226 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 10:48:22.001343 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 10:48:22.001523 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10258,"thread_start_us":10007,"threads_started":1}
I20260807 10:48:22.002305 8995 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cd5af48e9a4492ca02271faf5d6cb3a" candidate_uuid: "217efb3bfd904a04a56e89c508ef72bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df392badf9664056adda9c62c0130e49"
I20260807 10:48:22.002516 8995 raft_consensus.cc:3037] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:22.002998 8625 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cd5af48e9a4492ca02271faf5d6cb3a" candidate_uuid: "217efb3bfd904a04a56e89c508ef72bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6b8d892ade4658871733f69f3a588e" is_pre_election: true
I20260807 10:48:22.003074 8623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cd5af48e9a4492ca02271faf5d6cb3a" candidate_uuid: "217efb3bfd904a04a56e89c508ef72bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6b8d892ade4658871733f69f3a588e"
I20260807 10:48:22.003592 8625 raft_consensus.cc:2454] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 217efb3bfd904a04a56e89c508ef72bd in term 0.
I20260807 10:48:22.005264 8995 raft_consensus.cc:2454] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 217efb3bfd904a04a56e89c508ef72bd in term 1.
I20260807 10:48:22.005697 8722 leader_election.cc:302] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 217efb3bfd904a04a56e89c508ef72bd, df392badf9664056adda9c62c0130e49; no voters: fe6b8d892ade4658871733f69f3a588e
I20260807 10:48:22.006037 9103 raft_consensus.cc:2781] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:22.006466 9103 raft_consensus.cc:686] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 1 LEADER]: Becoming Leader. State: Replica: 217efb3bfd904a04a56e89c508ef72bd, State: Running, Role: LEADER
I20260807 10:48:22.006958 9103 consensus_queue.cc:237] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "217efb3bfd904a04a56e89c508ef72bd" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32881 } } peers { permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 } } peers { permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 } }
I20260807 10:48:22.011945 8430 catalog_manager.cc:5495] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 217efb3bfd904a04a56e89c508ef72bd (127.11.46.130). New cstate: current_term: 1 leader_uuid: "217efb3bfd904a04a56e89c508ef72bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "217efb3bfd904a04a56e89c508ef72bd" member_type: VOTER last_known_addr { host: "127.11.46.130" port: 32881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 } health_report { overall_health: UNKNOWN } } }
W20260807 10:48:22.023353 8692 tablet.cc:2369] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:48:22.041288 9088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.035922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51704 (local address 127.11.46.130:32881)
0807 10:48:22.036157 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:22.036162 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:22.036182 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:48:22.036369 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:22.036373 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:22.036483 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:22.036616 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:48:22.036902 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:22.037671 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:22.038978 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:22.039466 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:22.039563 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:22.040065 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:48:22.040683 (+ 618us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:48:22.040804 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:22.040914 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 10:48:22.040992 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 10:48:22.050068 8625 raft_consensus.cc:3037] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:22.050369 8995 raft_consensus.cc:1261] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49 [term 1 FOLLOWER]: Refusing update from remote peer 217efb3bfd904a04a56e89c508ef72bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:48:22.051397 9113 consensus_queue.cc:1035] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "df392badf9664056adda9c62c0130e49" member_type: VOTER last_known_addr { host: "127.11.46.131" port: 39419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:48:22.053100 8625 raft_consensus.cc:1261] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e [term 1 FOLLOWER]: Refusing update from remote peer 217efb3bfd904a04a56e89c508ef72bd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:48:22.053985 9113 consensus_queue.cc:1035] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6b8d892ade4658871733f69f3a588e" member_type: VOTER last_known_addr { host: "127.11.46.129" port: 42357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:48:22.081863 8433 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:48:22.082245 8433 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 10:48:22.087637 8433 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64e1ff99601f4f3ab1a12719210a0b58: Sending DeleteTablet for 3 replicas of tablet 3cd5af48e9a4492ca02271faf5d6cb3a
I20260807 10:48:22.089000 8778 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cd5af48e9a4492ca02271faf5d6cb3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:22 UTC) from {username='slave'} at 127.0.0.1:51694
I20260807 10:48:22.089032 8960 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cd5af48e9a4492ca02271faf5d6cb3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:22 UTC) from {username='slave'} at 127.0.0.1:49592
I20260807 10:48:22.089457 8596 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cd5af48e9a4492ca02271faf5d6cb3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 10:48:22 UTC) from {username='slave'} at 127.0.0.1:34380
I20260807 10:48:22.091809 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 8514
I20260807 10:48:22.104323 9128 tablet_replica.cc:330] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: stopping tablet replica
I20260807 10:48:22.104950 9128 raft_consensus.cc:2229] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 1 LEADER]: Raft consensus shutting down.
I20260807 10:48:22.105840 9128 raft_consensus.cc:2258] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:22.108134 9128 ts_tablet_manager.cc:1905] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:22.116700 9128 ts_tablet_manager.cc:1918] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:48:22.116959 9128 log.cc:1196] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-1/wal/wals/3cd5af48e9a4492ca02271faf5d6cb3a
I20260807 10:48:22.117660 9128 ts_tablet_manager.cc:1939] T 3cd5af48e9a4492ca02271faf5d6cb3a P 217efb3bfd904a04a56e89c508ef72bd: Deleting consensus metadata
I20260807 10:48:22.120011 8412 catalog_manager.cc:4841] TS 217efb3bfd904a04a56e89c508ef72bd (127.11.46.130:32881): tablet 3cd5af48e9a4492ca02271faf5d6cb3a (table test-table [id=ff536e070b6b47a3b929d3b58301095e]) successfully deleted
I20260807 10:48:22.121394 9130 tablet_replica.cc:330] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e: stopping tablet replica
I20260807 10:48:22.122047 9130 raft_consensus.cc:2229] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:48:22.128839 9091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.093239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34392 (local address 127.11.46.129:42357)
0807 10:48:22.093477 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:22.093485 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:22.118505 (+ 25020us) server_negotiation.cc:407] Connection header received
0807 10:48:22.118830 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:22.118838 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:22.119002 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:22.119085 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:22.120839 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:22.122476 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:22.124452 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:22.125139 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:22.125256 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:22.126854 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:22.126868 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:22.126890 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:22.127830 (+ 940us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:22.127912 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:22.127951 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:22.128045 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:22.128314 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 10:48:22.128454 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 10:48:22.133675 9130 raft_consensus.cc:2258] T 3cd5af48e9a4492ca02271faf5d6cb3a P fe6b8d892ade4658871733f69f3a588e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:22.134471 8683 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:22.135740 9129 tablet_replica.cc:330] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: stopping tablet replica
I20260807 10:48:22.136287 9129 raft_consensus.cc:2229] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 10:48:22.136894 9129 raft_consensus.cc:2258] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 10:48:22.139504 9129 ts_tablet_manager.cc:1905] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 10:48:22.148443 9129 ts_tablet_manager.cc:1918] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 10:48:22.149549 9129 log.cc:1196] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: Deleting WAL directory at /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786099355061134-11450-0/minicluster-data/ts-2/wal/wals/3cd5af48e9a4492ca02271faf5d6cb3a
I20260807 10:48:22.150202 9129 ts_tablet_manager.cc:1939] T 3cd5af48e9a4492ca02271faf5d6cb3a P df392badf9664056adda9c62c0130e49: Deleting consensus metadata
I20260807 10:48:22.152714 8412 catalog_manager.cc:4841] TS df392badf9664056adda9c62c0130e49 (127.11.46.131:39419): tablet 3cd5af48e9a4492ca02271faf5d6cb3a (table test-table [id=ff536e070b6b47a3b929d3b58301095e]) successfully deleted
I20260807 10:48:22.240782 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 8514
I20260807 10:48:22.269253 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 8696
W20260807 10:48:22.269408 8411 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.46.129:42357 (error 108)
I20260807 10:48:22.273581 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.272888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:42357 (local address 127.0.0.1:34400)
0807 10:48:22.273163 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:22.273303 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:42357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260807 10:48:22.273910 8411 catalog_manager.cc:4584] TS fe6b8d892ade4658871733f69f3a588e (127.11.46.129:42357): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3cd5af48e9a4492ca02271faf5d6cb3a: Network error: Client connection negotiation failed: client connection to 127.11.46.129:42357: connect: Connection refused (error 111)
I20260807 10:48:22.277895 9088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.270223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51710 (local address 127.11.46.130:32881)
0807 10:48:22.270476 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:22.270483 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:22.270508 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:48:22.270727 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:22.270733 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:22.270861 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:22.270988 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:22.271602 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:22.272462 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:22.274349 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:22.274913 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:22.275061 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:22.276256 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:22.276266 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:22.276283 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:22.276967 (+ 684us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:22.277027 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:22.277051 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:22.277173 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:22.277334 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 10:48:22.277493 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 10:48:22.278712 8864 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:22.327841 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.327321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:42357 (local address 127.0.0.1:34408)
0807 10:48:22.327575 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:22.327673 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:42357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260807 10:48:22.328925 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.328526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:42357 (local address 127.0.0.1:34414)
0807 10:48:22.328692 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:22.328773 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:42357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 10:48:22.389832 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.389146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:42357 (local address 127.0.0.1:34428)
0807 10:48:22.389383 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:22.389536 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:42357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260807 10:48:22.391079 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.390660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:42357 (local address 127.0.0.1:34432)
0807 10:48:22.390826 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:22.390908 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:42357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 10:48:22.399741 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 8696
I20260807 10:48:22.434489 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 8880
I20260807 10:48:22.440831 9093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.435266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49604 (local address 127.11.46.131:39419)
0807 10:48:22.435457 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:22.435462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:22.435527 (+ 65us) server_negotiation.cc:407] Connection header received
0807 10:48:22.435707 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:22.435712 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:22.435803 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:22.435907 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:22.436231 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:22.436967 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:22.438172 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:22.438558 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:22.438653 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:22.439598 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:22.439608 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:22.439625 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:22.440221 (+ 596us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:22.440271 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:22.440293 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:22.440401 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:22.440476 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 10:48:22.440576 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 10:48:22.441514 9056 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:22.471617 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.471113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:42357 (local address 127.0.0.1:34438)
0807 10:48:22.471333 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:22.471429 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:42357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 10:48:22.472704 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.472271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:42357 (local address 127.0.0.1:34452)
0807 10:48:22.472472 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:22.472565 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:42357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260807 10:48:22.533267 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 8880
I20260807 10:48:22.558264 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 8387
I20260807 10:48:22.559486 8470 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:22.672574 9086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:22.671168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.129:42357 (local address 127.0.0.1:34454)
0807 10:48:22.672232 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0807 10:48:22.672359 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.129:42357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":703}
I20260807 10:48:22.673076 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 8387
2026-08-07T10:48:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3170 ms)
[----------] 6 tests from EncryptionPolicyTest (27447 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:22 dist-test-slave-42z9 krb5kdc[9143](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:22 dist-test-slave-42z9 krb5kdc[9143](info): set up 2 sockets
Aug 07 10:48:22 dist-test-slave-42z9 krb5kdc[9143](info): commencing operation
krb5kdc: starting...
W20260807 10:48:23.939944 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.010s sys 0.058s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:24 dist-test-slave-42z9 krb5kdc[9143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:24.332823 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37399
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:24.707062 9165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:24.707409 9165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:24.707564 9165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:24.715061 9165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:24.715200 9165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:24.715281 9165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:24.715368 9165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:24.715426 9165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:24.726305 9165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37399
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:24.727880 9165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:24.729480 9165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:24.742650 9177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:24.742650 9174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:24.743237 9173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:24.743553 9165 server_base.cc:1034] running on GCE node
I20260807 10:48:24.744501 9165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:24.746294 9165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:24.747543 9165 hybrid_clock.cc:648] HybridClock initialized: now 1786099704747487 us; error 54 us; skew 500 ppm
I20260807 10:48:24.747997 9165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:24 dist-test-slave-42z9 krb5kdc[9143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099704, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:24.751673 9165 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:24.753566 9165 webserver.cc:460] Webserver started at http://127.0.0.1:44849/ using document root <none> and password file <none>
I20260807 10:48:24.754383 9165 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:24.754509 9165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:24.754829 9165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:24.758407 9165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "f7f30ceb66a440eb9a8df9356323cd8b"
format_stamp: "Formatted at 2026-08-07 10:48:24 on dist-test-slave-42z9"
server_key: "50a38d2cde16bbc7ca245926d2aab0a4"
server_key_iv: "6c663479c728398f0201236d424658d6"
server_key_version: "encryptionkey@0"
I20260807 10:48:24.759321 9165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "f7f30ceb66a440eb9a8df9356323cd8b"
format_stamp: "Formatted at 2026-08-07 10:48:24 on dist-test-slave-42z9"
server_key: "50a38d2cde16bbc7ca245926d2aab0a4"
server_key_iv: "6c663479c728398f0201236d424658d6"
server_key_version: "encryptionkey@0"
I20260807 10:48:24.765965 9165 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:48:24.770355 9186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:24.772032 9165 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.003s
I20260807 10:48:24.772264 9165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "f7f30ceb66a440eb9a8df9356323cd8b"
format_stamp: "Formatted at 2026-08-07 10:48:24 on dist-test-slave-42z9"
server_key: "50a38d2cde16bbc7ca245926d2aab0a4"
server_key_iv: "6c663479c728398f0201236d424658d6"
server_key_version: "encryptionkey@0"
I20260807 10:48:24.772508 9165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:24.790957 9165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:24.795567 9165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:24.795881 9165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:24.815613 9165 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37399
I20260807 10:48:24.815634 9253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37399 every 8 connection(s)
I20260807 10:48:24.817086 9165 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:24.821341 9254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:24.821936 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 9165
I20260807 10:48:24.822145 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:24.822810 11450 external_mini_cluster.cc:1428] Setting key 7a89a706f43c91ede00e730cf8809a8e
I20260807 10:48:24.837039 9254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b: Bootstrap starting.
Aug 07 10:48:24 dist-test-slave-42z9 krb5kdc[9143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 10:48:24.840696 9254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:24.842204 9254 log.cc:824] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:24.845355 9254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b: No bootstrap required, opened a new log
I20260807 10:48:24.848729 9257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:24.824945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45535 (local address 127.0.0.1:37399)
0807 10:48:24.825842 (+ 897us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:24.825859 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:24.825926 (+ 67us) server_negotiation.cc:407] Connection header received
0807 10:48:24.828535 (+ 2609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:24.828599 (+ 64us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:24.829252 (+ 653us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:24.829802 (+ 550us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:24.831186 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:24.833164 (+ 1978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:24.834683 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:24.835842 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:24.836055 (+ 213us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:24.840368 (+ 4313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:24.840381 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:24.840402 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:24.840457 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:24.843962 (+ 3505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:24.844891 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:24.844899 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:24.844906 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:24.845099 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:24.845619 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:24.845623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:24.845625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:24.846260 (+ 635us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:24.846629 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:24.847167 (+ 538us) server_negotiation.cc:299] Negotiation successful
0807 10:48:24.847557 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":395,"threads_started":1}
I20260807 10:48:24.853147 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:24.854120 9254 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f30ceb66a440eb9a8df9356323cd8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37399 } }
I20260807 10:48:24.854522 9254 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:24.854625 9254 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7f30ceb66a440eb9a8df9356323cd8b, State: Initialized, Role: FOLLOWER
I20260807 10:48:24.855311 9254 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f30ceb66a440eb9a8df9356323cd8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37399 } }
I20260807 10:48:24.855599 9254 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:24.855744 9254 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:24.855908 9254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:24.858850 9254 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f30ceb66a440eb9a8df9356323cd8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37399 } }
I20260807 10:48:24.859613 9254 leader_election.cc:302] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7f30ceb66a440eb9a8df9356323cd8b; no voters:
I20260807 10:48:24.860265 9254 leader_election.cc:288] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:24.860464 9268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:24.862869 9254 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:24.867390 9268 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [term 1 LEADER]: Becoming Leader. State: Replica: f7f30ceb66a440eb9a8df9356323cd8b, State: Running, Role: LEADER
I20260807 10:48:24.868181 9268 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f30ceb66a440eb9a8df9356323cd8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37399 } }
I20260807 10:48:24.871346 9269 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7f30ceb66a440eb9a8df9356323cd8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f30ceb66a440eb9a8df9356323cd8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37399 } } }
I20260807 10:48:24.871748 9269 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:24.872845 9287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:24.872148 9270 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7f30ceb66a440eb9a8df9356323cd8b. Latest consensus state: current_term: 1 leader_uuid: "f7f30ceb66a440eb9a8df9356323cd8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7f30ceb66a440eb9a8df9356323cd8b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37399 } } }
I20260807 10:48:24.873270 9270 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:24.878576 9257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:24.858490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48973 (local address 127.0.0.1:37399)
0807 10:48:24.858684 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:24.858690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:24.859057 (+ 367us) server_negotiation.cc:407] Connection header received
0807 10:48:24.859260 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:24.859266 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:24.859368 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:24.859483 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:24.861496 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:24.862675 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:24.864661 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:24.865573 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:24.865695 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:24.869679 (+ 3984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:24.869688 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:24.869694 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:24.869752 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:24.874297 (+ 4545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:24.875385 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:24.875392 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:24.875396 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:24.875579 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:24.876430 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:24.876437 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:24.876441 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:24.877034 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:24.877342 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:24.877930 (+ 588us) server_negotiation.cc:299] Negotiation successful
0807 10:48:24.878180 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 10:48:24.880805 9287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:24.891044 9287 catalog_manager.cc:1347] Generated new cluster ID: e867eda275a844f899d47739a2cbce05
I20260807 10:48:24.891197 9287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:24.906023 9287 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:24.908082 9287 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:24.921926 9287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7f30ceb66a440eb9a8df9356323cd8b: Generated new TSK 0
I20260807 10:48:24.922952 9287 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:24.933188 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 9165
I20260807 10:48:24.934794 9249 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:25.031158 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 9165
W20260807 10:48:25.059370 9140 connection.cc:535] client connection to 127.0.0.1:37399 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37399): Connection reset by peer (error 104)
2026-08-07T10:48:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2349 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:25 dist-test-slave-42z9 krb5kdc[9300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:25 dist-test-slave-42z9 krb5kdc[9300](info): set up 2 sockets
Aug 07 10:48:25 dist-test-slave-42z9 krb5kdc[9300](info): commencing operation
krb5kdc: starting...
W20260807 10:48:26.313382 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.070s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:26 dist-test-slave-42z9 krb5kdc[9300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:26.706372 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41897
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41897
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:27.094944 9319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:27.095301 9319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:27.095428 9319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:27.104620 9319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:27.104782 9319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:27.104862 9319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:27.104950 9319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:27.105015 9319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:27.116108 9319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41897
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:27.117725 9319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:27.119256 9319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:27.133339 9330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:27.133407 9329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:27.133405 9334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:27.134703 9319 server_base.cc:1034] running on GCE node
I20260807 10:48:27.135628 9319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:27.137283 9319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:27.138540 9319 hybrid_clock.cc:648] HybridClock initialized: now 1786099707138483 us; error 53 us; skew 500 ppm
I20260807 10:48:27.138955 9319 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:27 dist-test-slave-42z9 krb5kdc[9300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099707, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:27.145496 9319 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:27.147336 9319 webserver.cc:460] Webserver started at http://127.0.0.1:45387/ using document root <none> and password file <none>
I20260807 10:48:27.148154 9319 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:27.148288 9319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:27.148635 9319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:27.152859 9319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "9243963a211c487f889dbddb5209a823"
format_stamp: "Formatted at 2026-08-07 10:48:27 on dist-test-slave-42z9"
server_key: "22fdecec3cc3ebec5f526aac0723c130"
server_key_iv: "0ceed7d2ad2a754ccb22cad99a9bd5d4"
server_key_version: "encryptionkey@0"
I20260807 10:48:27.154069 9319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "9243963a211c487f889dbddb5209a823"
format_stamp: "Formatted at 2026-08-07 10:48:27 on dist-test-slave-42z9"
server_key: "22fdecec3cc3ebec5f526aac0723c130"
server_key_iv: "0ceed7d2ad2a754ccb22cad99a9bd5d4"
server_key_version: "encryptionkey@0"
I20260807 10:48:27.160609 9319 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260807 10:48:27.165400 9343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:27.167138 9319 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260807 10:48:27.167347 9319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "9243963a211c487f889dbddb5209a823"
format_stamp: "Formatted at 2026-08-07 10:48:27 on dist-test-slave-42z9"
server_key: "22fdecec3cc3ebec5f526aac0723c130"
server_key_iv: "0ceed7d2ad2a754ccb22cad99a9bd5d4"
server_key_version: "encryptionkey@0"
I20260807 10:48:27.167590 9319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:27.181713 9319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:27.186357 9319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:27.186709 9319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:27.207207 9319 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41897
I20260807 10:48:27.207230 9411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41897 every 8 connection(s)
I20260807 10:48:27.208803 9319 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:27.214078 9412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:27.218272 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 9319
I20260807 10:48:27.218534 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:27.219094 11450 external_mini_cluster.cc:1428] Setting key 08d7c6c616e9c1c6757840862d09eb1a
I20260807 10:48:27.230012 9412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823: Bootstrap starting.
I20260807 10:48:27.234679 9412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:27.236253 9412 log.cc:824] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:27.236624 9416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:27.221678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43665 (local address 127.0.0.1:41897)
0807 10:48:27.222628 (+ 950us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:27.222647 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:27.222708 (+ 61us) server_negotiation.cc:407] Connection header received
0807 10:48:27.224654 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:27.224699 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:27.225420 (+ 721us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:27.226016 (+ 596us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:27.226681 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:27.228805 (+ 2124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:27.230561 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:27.231687 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:27.231926 (+ 239us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:27.233294 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:27.233306 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:27.233329 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:27.234239 (+ 910us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:27.234362 (+ 123us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:27.234404 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:27.234603 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:27.234901 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 10:48:27.235143 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":401,"threads_started":1}
I20260807 10:48:27.239841 9412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823: No bootstrap required, opened a new log
I20260807 10:48:27.241293 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:27.251060 9412 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9243963a211c487f889dbddb5209a823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41897 } }
I20260807 10:48:27.251714 9412 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:27.251834 9412 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9243963a211c487f889dbddb5209a823, State: Initialized, Role: FOLLOWER
I20260807 10:48:27.252565 9412 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9243963a211c487f889dbddb5209a823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41897 } }
I20260807 10:48:27.252840 9412 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:27.252985 9412 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:27.253168 9412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:27.254297 9416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:27.246972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44535 (local address 127.0.0.1:41897)
0807 10:48:27.247219 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:27.247226 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:27.247519 (+ 293us) server_negotiation.cc:407] Connection header received
0807 10:48:27.247697 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:27.247703 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:27.247787 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:27.247912 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:27.248395 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:27.249604 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:27.251539 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:27.252099 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:27.252223 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:27.253480 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:27.253487 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:27.253491 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:27.253518 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:27.253586 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:27.253605 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:27.253709 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:27.253930 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 10:48:27.253995 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:48:27.256405 9412 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9243963a211c487f889dbddb5209a823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41897 } }
I20260807 10:48:27.256982 9412 leader_election.cc:302] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9243963a211c487f889dbddb5209a823; no voters:
I20260807 10:48:27.257656 9412 leader_election.cc:288] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:27.257789 9425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:27.258464 9425 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [term 1 LEADER]: Becoming Leader. State: Replica: 9243963a211c487f889dbddb5209a823, State: Running, Role: LEADER
I20260807 10:48:27.259128 9425 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9243963a211c487f889dbddb5209a823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41897 } }
I20260807 10:48:27.259943 9412 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:27.262118 9427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9243963a211c487f889dbddb5209a823. Latest consensus state: current_term: 1 leader_uuid: "9243963a211c487f889dbddb5209a823" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9243963a211c487f889dbddb5209a823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41897 } } }
I20260807 10:48:27.262571 9427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:27.263465 9426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9243963a211c487f889dbddb5209a823" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9243963a211c487f889dbddb5209a823" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41897 } } }
I20260807 10:48:27.263830 9426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:27.264945 9431 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:27.272089 9431 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:27.282821 9431 catalog_manager.cc:1347] Generated new cluster ID: ba2e48c1779a4c79b28e0fdd3aee983a
I20260807 10:48:27.282968 9431 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:27.296367 9431 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:27.298496 9431 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:27.310127 9431 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9243963a211c487f889dbddb5209a823: Generated new TSK 0
I20260807 10:48:27.311143 9431 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:27.324025 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 9319
W20260807 10:48:27.325783 9406 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43665
W20260807 10:48:27.327065 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 9319: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:48:27.327353 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 9319
W20260807 10:48:27.359894 9297 connection.cc:535] client connection to 127.0.0.1:41897 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41897): Connection reset by peer (error 104)
2026-08-07T10:48:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2300 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:27 dist-test-slave-42z9 krb5kdc[9460](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:27 dist-test-slave-42z9 krb5kdc[9460](info): set up 2 sockets
Aug 07 10:48:27 dist-test-slave-42z9 krb5kdc[9460](info): commencing operation
krb5kdc: starting...
W20260807 10:48:28.598093 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.000s sys 0.070s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:28 dist-test-slave-42z9 krb5kdc[9460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:28.988750 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40961
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40961
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:29.371245 9478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:29.371590 9478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:29.371722 9478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:29.379513 9478 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:29.379667 9478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:29.379751 9478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:29.379843 9478 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:29.379904 9478 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:29.390576 9478 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40961
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:29.392081 9478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:29.393626 9478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:29.406376 9490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:29.406472 9492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:29.406452 9488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:29.407148 9478 server_base.cc:1034] running on GCE node
I20260807 10:48:29.408190 9478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:29.409916 9478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:29.411171 9478 hybrid_clock.cc:648] HybridClock initialized: now 1786099709411107 us; error 57 us; skew 500 ppm
I20260807 10:48:29.411574 9478 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:29 dist-test-slave-42z9 krb5kdc[9460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099709, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:29.415045 9478 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:29.416811 9478 webserver.cc:460] Webserver started at http://127.0.0.1:35477/ using document root <none> and password file <none>
I20260807 10:48:29.417697 9478 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:29.417845 9478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:29.418198 9478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:29.421687 9478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "626196797b9647b7a4151657601efe8a"
format_stamp: "Formatted at 2026-08-07 10:48:29 on dist-test-slave-42z9"
server_key: "66d91068d9a492a2bac592871c37c9ce"
server_key_iv: "654982ef067ec6d428c076cc842ee666"
server_key_version: "encryptionkey@0"
I20260807 10:48:29.422569 9478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "626196797b9647b7a4151657601efe8a"
format_stamp: "Formatted at 2026-08-07 10:48:29 on dist-test-slave-42z9"
server_key: "66d91068d9a492a2bac592871c37c9ce"
server_key_iv: "654982ef067ec6d428c076cc842ee666"
server_key_version: "encryptionkey@0"
I20260807 10:48:29.428777 9478 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:48:29.433171 9499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:29.434880 9478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 10:48:29.435111 9478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "626196797b9647b7a4151657601efe8a"
format_stamp: "Formatted at 2026-08-07 10:48:29 on dist-test-slave-42z9"
server_key: "66d91068d9a492a2bac592871c37c9ce"
server_key_iv: "654982ef067ec6d428c076cc842ee666"
server_key_version: "encryptionkey@0"
I20260807 10:48:29.435340 9478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:29.441895 9478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:29.446393 9478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:29.446727 9478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:29.466537 9478 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40961
I20260807 10:48:29.466588 9576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40961 every 8 connection(s)
I20260807 10:48:29.468137 9478 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:29.468786 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 9478
I20260807 10:48:29.468954 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:29.469610 11450 external_mini_cluster.cc:1428] Setting key 4cf33a42f38eb88890efb8ad361de3e4
I20260807 10:48:29.472703 9577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:29.479653 9581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:29.471683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58181 (local address 127.0.0.1:40961)
0807 10:48:29.472674 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:29.472695 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:29.473048 (+ 353us) server_negotiation.cc:407] Connection header received
0807 10:48:29.475449 (+ 2401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:29.475481 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:29.475962 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:29.476454 (+ 492us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:29.477530 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:29.477539 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:29.477557 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:29.477576 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:29.477673 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:29.477707 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:29.477931 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:29.478086 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 10:48:29.478300 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":404,"threads_started":1}
I20260807 10:48:29.483814 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:29.488066 9577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a: Bootstrap starting.
I20260807 10:48:29.491983 9581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:29.489486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43307 (local address 127.0.0.1:40961)
0807 10:48:29.489693 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:29.489699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:29.490013 (+ 314us) server_negotiation.cc:407] Connection header received
0807 10:48:29.490213 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:29.490217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:29.490272 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:29.490364 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:29.491337 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:29.491342 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:29.491345 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:29.491362 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:29.491406 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:29.491421 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:29.491515 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:29.491640 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 10:48:29.491698 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 10:48:29.492446 9577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:29.493722 9577 log.cc:824] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:29.496819 9577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a: No bootstrap required, opened a new log
I20260807 10:48:29.504954 9577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626196797b9647b7a4151657601efe8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40961 } }
I20260807 10:48:29.505385 9577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:29.505530 9577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 626196797b9647b7a4151657601efe8a, State: Initialized, Role: FOLLOWER
I20260807 10:48:29.506140 9577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626196797b9647b7a4151657601efe8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40961 } }
I20260807 10:48:29.506372 9577 raft_consensus.cc:388] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:29.506526 9577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:29.506707 9577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:29.509332 9577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626196797b9647b7a4151657601efe8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40961 } }
I20260807 10:48:29.510047 9577 leader_election.cc:302] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 626196797b9647b7a4151657601efe8a; no voters:
I20260807 10:48:29.510687 9577 leader_election.cc:288] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:29.510826 9591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:29.511511 9591 raft_consensus.cc:686] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [term 1 LEADER]: Becoming Leader. State: Replica: 626196797b9647b7a4151657601efe8a, State: Running, Role: LEADER
I20260807 10:48:29.512085 9591 consensus_queue.cc:237] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626196797b9647b7a4151657601efe8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40961 } }
I20260807 10:48:29.513005 9577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:29.515708 9593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 626196797b9647b7a4151657601efe8a. Latest consensus state: current_term: 1 leader_uuid: "626196797b9647b7a4151657601efe8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626196797b9647b7a4151657601efe8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40961 } } }
I20260807 10:48:29.516199 9593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:29.517174 9601 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:29.517016 9592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "626196797b9647b7a4151657601efe8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "626196797b9647b7a4151657601efe8a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40961 } } }
I20260807 10:48:29.517462 9592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:29.523480 9601 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:29.533586 9601 catalog_manager.cc:1347] Generated new cluster ID: a7d7803c8d0b410f91d0c51b6e7d7134
I20260807 10:48:29.533731 9601 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:29.564273 9601 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:29.564782 9601 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:29.585389 9601 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 626196797b9647b7a4151657601efe8a: Generated new TSK 0
I20260807 10:48:29.586391 9601 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:29.604265 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 9478
W20260807 10:48:29.605562 9571 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58181
W20260807 10:48:29.606305 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 9478: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:48:29.606478 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 9478
2026-08-07T10:48:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2272 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:29 dist-test-slave-42z9 krb5kdc[9617](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:29 dist-test-slave-42z9 krb5kdc[9617](info): set up 2 sockets
Aug 07 10:48:29 dist-test-slave-42z9 krb5kdc[9617](info): commencing operation
krb5kdc: starting...
W20260807 10:48:30.874557 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.066s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:31 dist-test-slave-42z9 krb5kdc[9617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:31.274693 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37773
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:31.658957 9632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:31.659317 9632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:31.659492 9632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:31.667163 9632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:31.667310 9632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:31.667397 9632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:31.667492 9632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:31.667555 9632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:31.678524 9632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37773
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:31.680106 9632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:31.681670 9632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:31.694818 9637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:31.694934 9641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:31.694923 9638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:31.696112 9632 server_base.cc:1034] running on GCE node
I20260807 10:48:31.697079 9632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:31.698868 9632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:31.700130 9632 hybrid_clock.cc:648] HybridClock initialized: now 1786099711700071 us; error 54 us; skew 500 ppm
I20260807 10:48:31.700562 9632 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:31 dist-test-slave-42z9 krb5kdc[9617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099711, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:31.704170 9632 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:31.706086 9632 webserver.cc:460] Webserver started at http://127.0.0.1:43791/ using document root <none> and password file <none>
I20260807 10:48:31.706898 9632 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:31.707046 9632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:31.707391 9632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:31.711120 9632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "ce7c6fe5f92541479f63222e8fa37fd1"
format_stamp: "Formatted at 2026-08-07 10:48:31 on dist-test-slave-42z9"
server_key: "c8f08b1b4c6dac459ff55d2e5b420aed"
server_key_iv: "7e8cdd1bfc5addfdeec8d6975875b788"
server_key_version: "encryptionkey@0"
I20260807 10:48:31.712124 9632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "ce7c6fe5f92541479f63222e8fa37fd1"
format_stamp: "Formatted at 2026-08-07 10:48:31 on dist-test-slave-42z9"
server_key: "c8f08b1b4c6dac459ff55d2e5b420aed"
server_key_iv: "7e8cdd1bfc5addfdeec8d6975875b788"
server_key_version: "encryptionkey@0"
I20260807 10:48:31.718516 9632 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:48:31.722836 9649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:31.724472 9632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:48:31.724690 9632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "ce7c6fe5f92541479f63222e8fa37fd1"
format_stamp: "Formatted at 2026-08-07 10:48:31 on dist-test-slave-42z9"
server_key: "c8f08b1b4c6dac459ff55d2e5b420aed"
server_key_iv: "7e8cdd1bfc5addfdeec8d6975875b788"
server_key_version: "encryptionkey@0"
I20260807 10:48:31.724926 9632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:31.747828 9632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:31.752509 9632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:31.752836 9632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:31.772542 9632 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37773
I20260807 10:48:31.772581 9733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37773 every 8 connection(s)
I20260807 10:48:31.774111 9632 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:31.778376 9735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:31.779459 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 9632
I20260807 10:48:31.779659 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:31.780270 11450 external_mini_cluster.cc:1428] Setting key e2daa1316647866fb5df7704716820c7
I20260807 10:48:31.793908 9735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1: Bootstrap starting.
Aug 07 10:48:31 dist-test-slave-42z9 krb5kdc[9617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 10:48:31.798235 9735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:31.799558 9735 log.cc:824] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:31.803206 9735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1: No bootstrap required, opened a new log
I20260807 10:48:31.806082 9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:31.782330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41643 (local address 127.0.0.1:37773)
0807 10:48:31.783273 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:31.783286 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:31.783338 (+ 52us) server_negotiation.cc:407] Connection header received
0807 10:48:31.785296 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:31.785328 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:31.785911 (+ 583us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:31.786300 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:31.788319 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:31.789775 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:31.791789 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:31.792581 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:31.792740 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:31.797868 (+ 5128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:31.797878 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:31.797904 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:31.797950 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:31.801507 (+ 3557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:31.802438 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:31.802447 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:31.802456 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:31.802659 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:31.803134 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:31.803137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:31.803139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:31.803757 (+ 618us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:31.804010 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:31.804519 (+ 509us) server_negotiation.cc:299] Negotiation successful
0807 10:48:31.804879 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":397,"threads_started":1}
I20260807 10:48:31.810443 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:31.813321 9735 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7c6fe5f92541479f63222e8fa37fd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37773 } }
I20260807 10:48:31.813932 9735 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:31.814080 9735 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce7c6fe5f92541479f63222e8fa37fd1, State: Initialized, Role: FOLLOWER
I20260807 10:48:31.814917 9735 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7c6fe5f92541479f63222e8fa37fd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37773 } }
I20260807 10:48:31.815253 9735 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:31.815425 9735 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:31.815624 9735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:31.818558 9735 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7c6fe5f92541479f63222e8fa37fd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37773 } }
I20260807 10:48:31.819253 9735 leader_election.cc:302] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce7c6fe5f92541479f63222e8fa37fd1; no voters:
I20260807 10:48:31.820118 9735 leader_election.cc:288] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:31.820241 9748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:31.821426 9748 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [term 1 LEADER]: Becoming Leader. State: Replica: ce7c6fe5f92541479f63222e8fa37fd1, State: Running, Role: LEADER
I20260807 10:48:31.822114 9748 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7c6fe5f92541479f63222e8fa37fd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37773 } }
I20260807 10:48:31.822759 9735 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:31.825173 9749 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce7c6fe5f92541479f63222e8fa37fd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7c6fe5f92541479f63222e8fa37fd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37773 } } }
I20260807 10:48:31.825613 9749 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:31.831209 9750 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce7c6fe5f92541479f63222e8fa37fd1. Latest consensus state: current_term: 1 leader_uuid: "ce7c6fe5f92541479f63222e8fa37fd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce7c6fe5f92541479f63222e8fa37fd1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37773 } } }
I20260807 10:48:31.832394 9750 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:31.836333 9738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:31.816273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34065 (local address 127.0.0.1:37773)
0807 10:48:31.816496 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:31.816507 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:31.816988 (+ 481us) server_negotiation.cc:407] Connection header received
0807 10:48:31.817155 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:31.817160 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:31.817250 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:31.817377 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:31.819071 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:31.820318 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:31.822272 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:31.822988 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:31.823138 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:31.826731 (+ 3593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:31.826740 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:31.826746 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:31.826803 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:31.831096 (+ 4293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:31.832316 (+ 1220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:31.832323 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:31.832328 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:31.832577 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:31.833151 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:31.833157 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:31.833161 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:31.833710 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:31.835351 (+ 1641us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:31.835575 (+ 224us) server_negotiation.cc:299] Negotiation successful
0807 10:48:31.835876 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:48:31.840013 9755 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:31.846326 9755 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:31.857493 9755 catalog_manager.cc:1347] Generated new cluster ID: 9030f8932c004c40a77ed3e625689aa5
I20260807 10:48:31.857645 9755 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:31.874928 9755 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:31.877127 9755 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:31.890910 9755 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce7c6fe5f92541479f63222e8fa37fd1: Generated new TSK 0
I20260807 10:48:31.892135 9755 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:31.899019 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 9632
I20260807 10:48:31.900489 9727 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:31.995209 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 9632
2026-08-07T10:48:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2390 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:32 dist-test-slave-42z9 krb5kdc[9780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:32 dist-test-slave-42z9 krb5kdc[9780](info): set up 2 sockets
Aug 07 10:48:32 dist-test-slave-42z9 krb5kdc[9780](info): commencing operation
krb5kdc: starting...
W20260807 10:48:33.272708 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.004s sys 0.065s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:33 dist-test-slave-42z9 krb5kdc[9780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099713, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:33.668349 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41789
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:34.047909 9799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:34.048239 9799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:34.048377 9799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:34.055891 9799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:34.056023 9799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:34.056111 9799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:34.056190 9799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:34.056245 9799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:34.067143 9799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41789
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:34.068640 9799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:34.070046 9799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:34.082533 9804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:34.082564 9807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:34.082479 9805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:34.083226 9799 server_base.cc:1034] running on GCE node
I20260807 10:48:34.084108 9799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:34.085629 9799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:34.086838 9799 hybrid_clock.cc:648] HybridClock initialized: now 1786099714086791 us; error 35 us; skew 500 ppm
I20260807 10:48:34.087224 9799 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:34 dist-test-slave-42z9 krb5kdc[9780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099714, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:34.090566 9799 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:34.092229 9799 webserver.cc:460] Webserver started at http://127.0.0.1:42695/ using document root <none> and password file <none>
I20260807 10:48:34.093017 9799 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:34.093153 9799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:34.093534 9799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:34.096894 9799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "44b8c96c74c14c089024c42b4b6b7671"
format_stamp: "Formatted at 2026-08-07 10:48:34 on dist-test-slave-42z9"
server_key: "a38ccbe504b7c11da5140eb36490571e"
server_key_iv: "438cffc9da3b8689b4338b9a92992583"
server_key_version: "encryptionkey@0"
I20260807 10:48:34.097779 9799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "44b8c96c74c14c089024c42b4b6b7671"
format_stamp: "Formatted at 2026-08-07 10:48:34 on dist-test-slave-42z9"
server_key: "a38ccbe504b7c11da5140eb36490571e"
server_key_iv: "438cffc9da3b8689b4338b9a92992583"
server_key_version: "encryptionkey@0"
I20260807 10:48:34.103824 9799 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:48:34.108091 9819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:34.109822 9799 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:48:34.110055 9799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "44b8c96c74c14c089024c42b4b6b7671"
format_stamp: "Formatted at 2026-08-07 10:48:34 on dist-test-slave-42z9"
server_key: "a38ccbe504b7c11da5140eb36490571e"
server_key_iv: "438cffc9da3b8689b4338b9a92992583"
server_key_version: "encryptionkey@0"
I20260807 10:48:34.110291 9799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:34.135761 9799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:34.140472 9799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:34.140792 9799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:34.160267 9799 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41789
I20260807 10:48:34.160286 9897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41789 every 8 connection(s)
I20260807 10:48:34.161919 9799 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:34.166306 9898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:34.168184 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 9799
I20260807 10:48:34.168390 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:34.168848 11450 external_mini_cluster.cc:1428] Setting key 89a6e1cf2e9deb378f3e24994eba7d34
I20260807 10:48:34.182747 9898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671: Bootstrap starting.
I20260807 10:48:34.184942 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:34.171026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56809 (local address 127.0.0.1:41789)
0807 10:48:34.171969 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:34.171988 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:34.172059 (+ 71us) server_negotiation.cc:407] Connection header received
0807 10:48:34.173994 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:34.174039 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:34.174730 (+ 691us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:34.175250 (+ 520us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:34.175836 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:34.177803 (+ 1967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:34.179220 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:34.180402 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:34.180608 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:34.181816 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:34.181829 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:34.181853 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:34.182638 (+ 785us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:34.182766 (+ 128us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:34.182809 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:34.182932 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:34.183141 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 10:48:34.183484 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":387,"threads_started":1}
I20260807 10:48:34.187165 9898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:34.188624 9898 log.cc:824] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:34.189736 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:34.192045 9898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671: No bootstrap required, opened a new log
I20260807 10:48:34.200767 9901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:34.194540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36431 (local address 127.0.0.1:41789)
0807 10:48:34.194736 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:34.194743 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:34.195124 (+ 381us) server_negotiation.cc:407] Connection header received
0807 10:48:34.195320 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:34.195325 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:34.195404 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:34.195506 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:34.196107 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:34.196854 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:34.198217 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:34.198721 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:34.198850 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:34.200040 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:34.200045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:34.200048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:34.200069 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:34.200113 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:34.200130 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:34.200211 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:34.200349 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 10:48:34.200461 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 10:48:34.200853 9898 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b8c96c74c14c089024c42b4b6b7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } }
I20260807 10:48:34.201352 9898 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:34.201495 9898 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44b8c96c74c14c089024c42b4b6b7671, State: Initialized, Role: FOLLOWER
I20260807 10:48:34.202158 9898 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b8c96c74c14c089024c42b4b6b7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } }
I20260807 10:48:34.202466 9898 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:34.202628 9898 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:34.202803 9898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:34.205354 9898 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b8c96c74c14c089024c42b4b6b7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } }
I20260807 10:48:34.206064 9898 leader_election.cc:302] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44b8c96c74c14c089024c42b4b6b7671; no voters:
I20260807 10:48:34.206702 9898 leader_election.cc:288] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:34.206827 9909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:34.207614 9909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [term 1 LEADER]: Becoming Leader. State: Replica: 44b8c96c74c14c089024c42b4b6b7671, State: Running, Role: LEADER
I20260807 10:48:34.208206 9909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b8c96c74c14c089024c42b4b6b7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } }
I20260807 10:48:34.209172 9898 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:34.211453 9912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44b8c96c74c14c089024c42b4b6b7671. Latest consensus state: current_term: 1 leader_uuid: "44b8c96c74c14c089024c42b4b6b7671" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b8c96c74c14c089024c42b4b6b7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } } }
I20260807 10:48:34.212000 9912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:34.211474 9910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44b8c96c74c14c089024c42b4b6b7671" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44b8c96c74c14c089024c42b4b6b7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41789 } } }
I20260807 10:48:34.212498 9910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:34.214093 9916 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:34.219786 9916 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:34.230567 9916 catalog_manager.cc:1347] Generated new cluster ID: 45cce2b8f3564820a4815d2a7d7390bf
I20260807 10:48:34.230682 9916 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:34.260891 9916 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:34.262424 9916 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:34.271876 9916 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44b8c96c74c14c089024c42b4b6b7671: Generated new TSK 0
I20260807 10:48:34.272861 9916 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:34.282284 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 9799
W20260807 10:48:34.283553 9891 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56809
W20260807 10:48:34.284353 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 9799: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:48:34.284515 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 9799
2026-08-07T10:48:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2287 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:34 dist-test-slave-42z9 krb5kdc[9939](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:34 dist-test-slave-42z9 krb5kdc[9939](info): set up 2 sockets
Aug 07 10:48:34 dist-test-slave-42z9 krb5kdc[9939](info): commencing operation
krb5kdc: starting...
W20260807 10:48:35.552488 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.067s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:35 dist-test-slave-42z9 krb5kdc[9939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:35.961488 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46345
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:36.359570 9958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:36.359939 9958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:36.360090 9958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:36.367746 9958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:36.367918 9958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:36.368007 9958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:36.368094 9958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:36.368153 9958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:36.378857 9958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:36.380463 9958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:36.381978 9958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:36.394491 9963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:36.394412 9965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:36.394462 9967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:36.395324 9958 server_base.cc:1034] running on GCE node
I20260807 10:48:36.396282 9958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:36.398128 9958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:36.399384 9958 hybrid_clock.cc:648] HybridClock initialized: now 1786099716399299 us; error 76 us; skew 500 ppm
I20260807 10:48:36.399791 9958 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:36 dist-test-slave-42z9 krb5kdc[9939](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099716, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:36.403607 9958 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:36.405596 9958 webserver.cc:460] Webserver started at http://127.0.0.1:39523/ using document root <none> and password file <none>
I20260807 10:48:36.406448 9958 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:36.406582 9958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:36.406896 9958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:36.410495 9958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "0ab50e81bce64b28a749dc4207f0a01e"
format_stamp: "Formatted at 2026-08-07 10:48:36 on dist-test-slave-42z9"
server_key: "585dcea6df2998cc253d2dccfe5dec0b"
server_key_iv: "57527ccd5d25e38db4ffabc1ca522299"
server_key_version: "encryptionkey@0"
I20260807 10:48:36.411403 9958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "0ab50e81bce64b28a749dc4207f0a01e"
format_stamp: "Formatted at 2026-08-07 10:48:36 on dist-test-slave-42z9"
server_key: "585dcea6df2998cc253d2dccfe5dec0b"
server_key_iv: "57527ccd5d25e38db4ffabc1ca522299"
server_key_version: "encryptionkey@0"
I20260807 10:48:36.417996 9958 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:48:36.422451 9978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:36.424217 9958 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:48:36.424427 9958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "0ab50e81bce64b28a749dc4207f0a01e"
format_stamp: "Formatted at 2026-08-07 10:48:36 on dist-test-slave-42z9"
server_key: "585dcea6df2998cc253d2dccfe5dec0b"
server_key_iv: "57527ccd5d25e38db4ffabc1ca522299"
server_key_version: "encryptionkey@0"
I20260807 10:48:36.424664 9958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:36.431883 9958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:36.436393 9958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:36.436674 9958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:36.455900 9958 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46345
I20260807 10:48:36.455932 10057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46345 every 8 connection(s)
I20260807 10:48:36.457556 9958 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:36.461920 10059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:36.463445 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 9958
I20260807 10:48:36.463617 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:36.464051 11450 external_mini_cluster.cc:1428] Setting key 7277e48cf503b2e60f1707e6d477c621
I20260807 10:48:36.473601 10062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:36.466158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37227 (local address 127.0.0.1:46345)
0807 10:48:36.467169 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:36.467187 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:36.467251 (+ 64us) server_negotiation.cc:407] Connection header received
0807 10:48:36.469107 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:36.469147 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:36.469744 (+ 597us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:36.470299 (+ 555us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:36.471428 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:36.471437 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:36.471456 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:36.471477 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:36.471557 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:36.471591 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:36.471829 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:36.471974 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 10:48:36.472216 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":367,"threads_started":1}
I20260807 10:48:36.478498 10059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e: Bootstrap starting.
I20260807 10:48:36.478590 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:36.483206 10059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:36.484717 10059 log.cc:824] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:36.487003 10062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:36.484241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44503 (local address 127.0.0.1:46345)
0807 10:48:36.484449 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:36.484455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:36.484817 (+ 362us) server_negotiation.cc:407] Connection header received
0807 10:48:36.484997 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:36.485002 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:36.485058 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:36.485166 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:36.486311 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:36.486331 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:36.486337 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:36.486366 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:36.486413 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:36.486430 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:36.486539 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:36.486648 (+ 109us) server_negotiation.cc:299] Negotiation successful
0807 10:48:36.486719 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:48:36.488332 10059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e: No bootstrap required, opened a new log
I20260807 10:48:36.496511 10059 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab50e81bce64b28a749dc4207f0a01e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46345 } }
I20260807 10:48:36.496980 10059 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:36.497092 10059 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ab50e81bce64b28a749dc4207f0a01e, State: Initialized, Role: FOLLOWER
I20260807 10:48:36.497833 10059 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab50e81bce64b28a749dc4207f0a01e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46345 } }
I20260807 10:48:36.498126 10059 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:36.498301 10059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:36.498507 10059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:36.500955 10059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab50e81bce64b28a749dc4207f0a01e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46345 } }
I20260807 10:48:36.501597 10059 leader_election.cc:302] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ab50e81bce64b28a749dc4207f0a01e; no voters:
I20260807 10:48:36.502235 10059 leader_election.cc:288] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:36.502406 10070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:36.503983 10070 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [term 1 LEADER]: Becoming Leader. State: Replica: 0ab50e81bce64b28a749dc4207f0a01e, State: Running, Role: LEADER
I20260807 10:48:36.504658 10059 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:36.504614 10070 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab50e81bce64b28a749dc4207f0a01e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46345 } }
I20260807 10:48:36.508062 10071 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ab50e81bce64b28a749dc4207f0a01e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab50e81bce64b28a749dc4207f0a01e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46345 } } }
I20260807 10:48:36.508558 10071 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:36.509047 10075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ab50e81bce64b28a749dc4207f0a01e. Latest consensus state: current_term: 1 leader_uuid: "0ab50e81bce64b28a749dc4207f0a01e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ab50e81bce64b28a749dc4207f0a01e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46345 } } }
I20260807 10:48:36.509485 10075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:36.513496 10086 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:36.518435 10086 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:36.529506 10086 catalog_manager.cc:1347] Generated new cluster ID: 6bff09f7b4044d57bb54e7647a8c3241
I20260807 10:48:36.529716 10086 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:36.553591 10086 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:36.554105 10086 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:36.570523 10086 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ab50e81bce64b28a749dc4207f0a01e: Generated new TSK 0
I20260807 10:48:36.571496 10086 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:36.583639 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 9958
W20260807 10:48:36.584960 10048 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:37227
W20260807 10:48:36.585731 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 9958: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:48:36.585884 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 9958
2026-08-07T10:48:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2310 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:36 dist-test-slave-42z9 krb5kdc[10099](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:36 dist-test-slave-42z9 krb5kdc[10099](info): set up 2 sockets
Aug 07 10:48:36 dist-test-slave-42z9 krb5kdc[10099](info): commencing operation
krb5kdc: starting...
W20260807 10:48:37.860772 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.009s sys 0.062s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:38 dist-test-slave-42z9 krb5kdc[10099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:38.266196 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33511
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:38.660594 10116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:38.660970 10116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:38.661100 10116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:38.669170 10116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:38.669332 10116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:38.669402 10116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:38.669529 10116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:38.669585 10116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:38.680526 10116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33511
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:38.682129 10116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:38.683671 10116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:38.697196 10122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:38.697140 10124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:38.697224 10127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:38.698114 10116 server_base.cc:1034] running on GCE node
I20260807 10:48:38.699084 10116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:38.700793 10116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:38.702039 10116 hybrid_clock.cc:648] HybridClock initialized: now 1786099718701975 us; error 57 us; skew 500 ppm
I20260807 10:48:38.702447 10116 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:38 dist-test-slave-42z9 krb5kdc[10099](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099718, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:38.711687 10116 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:38.713631 10116 webserver.cc:460] Webserver started at http://127.0.0.1:46767/ using document root <none> and password file <none>
I20260807 10:48:38.714483 10116 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:38.714679 10116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:38.715024 10116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:38.718601 10116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "107d74f28faf40819a220d7d4d08b405"
format_stamp: "Formatted at 2026-08-07 10:48:38 on dist-test-slave-42z9"
server_key: "5cdbb7def3353bb76b2157541073fba9"
server_key_iv: "4ffdd2b59531568e9db7352ebb724261"
server_key_version: "encryptionkey@0"
I20260807 10:48:38.719637 10116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "107d74f28faf40819a220d7d4d08b405"
format_stamp: "Formatted at 2026-08-07 10:48:38 on dist-test-slave-42z9"
server_key: "5cdbb7def3353bb76b2157541073fba9"
server_key_iv: "4ffdd2b59531568e9db7352ebb724261"
server_key_version: "encryptionkey@0"
I20260807 10:48:38.727571 10116 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.003s
I20260807 10:48:38.732726 10139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:38.735179 10116 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260807 10:48:38.735569 10116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "107d74f28faf40819a220d7d4d08b405"
format_stamp: "Formatted at 2026-08-07 10:48:38 on dist-test-slave-42z9"
server_key: "5cdbb7def3353bb76b2157541073fba9"
server_key_iv: "4ffdd2b59531568e9db7352ebb724261"
server_key_version: "encryptionkey@0"
I20260807 10:48:38.735905 10116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:38.749655 10116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:38.755301 10116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:38.755678 10116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:38.777262 10116 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33511
I20260807 10:48:38.777282 10222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33511 every 8 connection(s)
I20260807 10:48:38.778918 10116 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:38.781018 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 10116
I20260807 10:48:38.781240 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:38.781867 11450 external_mini_cluster.cc:1428] Setting key 76f19df4d91f119d410b7d7e3a59d183
I20260807 10:48:38.784703 10223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:48:38 dist-test-slave-42z9 krb5kdc[10099](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 10:48:38.801838 10223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405: Bootstrap starting.
I20260807 10:48:38.805954 10223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:38.807397 10223 log.cc:824] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:38.811432 10223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405: No bootstrap required, opened a new log
I20260807 10:48:38.811641 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:38.784022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:44937 (local address 127.0.0.1:33511)
0807 10:48:38.784965 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:38.784981 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:38.785048 (+ 67us) server_negotiation.cc:407] Connection header received
0807 10:48:38.786954 (+ 1906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:38.786990 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:38.787636 (+ 646us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:38.788109 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:38.790838 (+ 2729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:38.792895 (+ 2057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:38.795048 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:38.796054 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:38.796276 (+ 222us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:38.802023 (+ 5747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:38.802039 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:38.802060 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:38.802119 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:38.805650 (+ 3531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:38.807051 (+ 1401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:38.807064 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:38.807076 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:38.807394 (+ 318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:38.808127 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:38.808139 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:38.808143 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:38.809129 (+ 986us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:38.809494 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:38.810091 (+ 597us) server_negotiation.cc:299] Negotiation successful
0807 10:48:38.810474 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":407,"threads_started":1}
I20260807 10:48:38.816437 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:38.822228 10223 raft_consensus.cc:348] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107d74f28faf40819a220d7d4d08b405" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260807 10:48:38.822718 10223 raft_consensus.cc:374] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:38.822826 10223 raft_consensus.cc:729] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 107d74f28faf40819a220d7d4d08b405, State: Initialized, Role: FOLLOWER
I20260807 10:48:38.823534 10223 consensus_queue.cc:260] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107d74f28faf40819a220d7d4d08b405" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260807 10:48:38.823855 10223 raft_consensus.cc:388] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:38.824020 10223 raft_consensus.cc:482] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:38.824227 10223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:38.827399 10223 raft_consensus.cc:504] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107d74f28faf40819a220d7d4d08b405" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260807 10:48:38.828156 10223 leader_election.cc:302] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 107d74f28faf40819a220d7d4d08b405; no voters:
I20260807 10:48:38.828845 10223 leader_election.cc:288] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:38.828976 10234 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:38.830039 10234 raft_consensus.cc:686] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [term 1 LEADER]: Becoming Leader. State: Replica: 107d74f28faf40819a220d7d4d08b405, State: Running, Role: LEADER
I20260807 10:48:38.830662 10234 consensus_queue.cc:237] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107d74f28faf40819a220d7d4d08b405" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260807 10:48:38.831516 10223 sys_catalog.cc:564] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:38.833606 10239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 107d74f28faf40819a220d7d4d08b405. Latest consensus state: current_term: 1 leader_uuid: "107d74f28faf40819a220d7d4d08b405" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107d74f28faf40819a220d7d4d08b405" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } } }
I20260807 10:48:38.834111 10239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:38.834275 10235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "107d74f28faf40819a220d7d4d08b405" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "107d74f28faf40819a220d7d4d08b405" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } } }
I20260807 10:48:38.834599 10235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:38.841686 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:38.822075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:57891 (local address 127.0.0.1:33511)
0807 10:48:38.822284 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:38.822290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:38.822851 (+ 561us) server_negotiation.cc:407] Connection header received
0807 10:48:38.823076 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:38.823081 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:38.823175 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:38.823289 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:38.825316 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:38.826274 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:38.827949 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:38.828427 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:38.828522 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:38.831887 (+ 3365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:38.831894 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:38.831898 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:38.831947 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:38.836587 (+ 4640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:38.837880 (+ 1293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:38.837887 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:38.837891 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:38.838149 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:38.838774 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:38.838780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:38.838784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:38.839246 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:38.840800 (+ 1554us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:38.841008 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 10:48:38.841225 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 10:48:38.848654 10246 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:38.854844 10246 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:38.865041 10246 catalog_manager.cc:1347] Generated new cluster ID: 358276be89454ae98fa7186bfab7f1ed
I20260807 10:48:38.865321 10246 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:38.879505 10246 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:38.881659 10246 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:38.892300 10246 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 107d74f28faf40819a220d7d4d08b405: Generated new TSK 0
I20260807 10:48:38.893258 10246 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:38.900256 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 10116
I20260807 10:48:38.901925 10212 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:38.998507 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 10116
W20260807 10:48:39.031498 10097 connection.cc:535] client connection to 127.0.0.1:33511 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33511): Connection reset by peer (error 104)
2026-08-07T10:48:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2411 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:39 dist-test-slave-42z9 krb5kdc[10269](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:39 dist-test-slave-42z9 krb5kdc[10269](info): set up 2 sockets
Aug 07 10:48:39 dist-test-slave-42z9 krb5kdc[10269](info): commencing operation
krb5kdc: starting...
W20260807 10:48:40.285095 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.001s sys 0.073s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:40 dist-test-slave-42z9 krb5kdc[10269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:40Z Disabled control of system clock
W20260807 10:48:40.725703 11450 mini_chronyd.cc:189] Time spent starting chronyd: real 0.141s user 0.000s sys 0.070s
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
W20260807 10:48:40.903277 11450 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.0.0.1: real 0.176s user 0.003s sys 0.071s
I20260807 10:48:40.908560 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36541
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:41.729089 10287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:41.730239 10287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:41.730579 10287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:41.754854 10287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:41.755232 10287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:41.755410 10287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:41.755759 10287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:41.755861 10287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:41.789000 10287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:41.792671 10287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:41.796564 10287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:41.833190 10294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:41.833377 10296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:41.833357 10293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:41.837062 10287 server_base.cc:1034] running on GCE node
I20260807 10:48:41.839980 10287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:41.845170 10287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:41.849208 10287 hybrid_clock.cc:648] HybridClock initialized: now 1786099721848838 us; error 175 us; skew 500 ppm
I20260807 10:48:41.850993 10287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:41 dist-test-slave-42z9 krb5kdc[10269](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099721, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:41.862706 10287 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:41.868110 10287 webserver.cc:460] Webserver started at http://127.0.0.1:44583/ using document root <none> and password file <none>
I20260807 10:48:41.870975 10287 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:41.871423 10287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:41.872341 10287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:41.884270 10287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "e2df577cea0342e98b29c0eee0b5b9d7"
format_stamp: "Formatted at 2026-08-07 10:48:41 on dist-test-slave-42z9"
server_key: "bcd03a9efdf227b7e8bfb3d0778a6d59"
server_key_iv: "b5fd2322979e91e02b03553ba879fd66"
server_key_version: "encryptionkey@0"
I20260807 10:48:41.887789 10287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "e2df577cea0342e98b29c0eee0b5b9d7"
format_stamp: "Formatted at 2026-08-07 10:48:41 on dist-test-slave-42z9"
server_key: "bcd03a9efdf227b7e8bfb3d0778a6d59"
server_key_iv: "b5fd2322979e91e02b03553ba879fd66"
server_key_version: "encryptionkey@0"
I20260807 10:48:41.908609 10287 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.018s sys 0.001s
I20260807 10:48:41.921193 10307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:41.924669 10287 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.006s sys 0.001s
I20260807 10:48:41.925135 10287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "e2df577cea0342e98b29c0eee0b5b9d7"
format_stamp: "Formatted at 2026-08-07 10:48:41 on dist-test-slave-42z9"
server_key: "bcd03a9efdf227b7e8bfb3d0778a6d59"
server_key_iv: "b5fd2322979e91e02b03553ba879fd66"
server_key_version: "encryptionkey@0"
I20260807 10:48:41.925673 10287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:41.977082 10287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:41.987696 10287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:41.988346 10287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:42.036993 10287 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36541
I20260807 10:48:42.037077 10375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36541 every 8 connection(s)
I20260807 10:48:42.042330 10287 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:42.049021 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 10287
I20260807 10:48:42.049407 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:42.050827 11450 external_mini_cluster.cc:1428] Setting key 96fa10b4d7d80d9dc29599fa5da04773
I20260807 10:48:42.056891 10376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:42.086133 10380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:42.056388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:35957 (local address 127.0.0.1:36541)
0807 10:48:42.059022 (+ 2634us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:42.059154 (+ 132us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:42.059378 (+ 224us) server_negotiation.cc:407] Connection header received
0807 10:48:42.068212 (+ 8834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:42.068323 (+ 111us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:42.070407 (+ 2084us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:42.072229 (+ 1822us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:42.074708 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:42.078458 (+ 3750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:42.080046 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:42.081142 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:42.081346 (+ 204us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:42.082796 (+ 1450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:42.082812 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:42.082833 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:42.083709 (+ 876us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:42.083828 (+ 119us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:42.083865 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:42.084076 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:42.084381 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 10:48:42.084611 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1284,"thread_start_us":660,"threads_started":1}
I20260807 10:48:42.087345 10376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7: Bootstrap starting.
I20260807 10:48:42.090986 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:42.091069 10376 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:42.092511 10376 log.cc:824] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:42.096524 10376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7: No bootstrap required, opened a new log
I20260807 10:48:42.104774 10380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:42.096406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:50617 (local address 127.0.0.1:36541)
0807 10:48:42.096602 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:42.096608 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:42.097161 (+ 553us) server_negotiation.cc:407] Connection header received
0807 10:48:42.097346 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:42.097353 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:42.097468 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:42.097600 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:42.098859 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:42.100111 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:42.101614 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:42.102335 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:42.102492 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:42.103883 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:42.103890 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:42.103894 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:42.103929 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:42.103991 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:42.104020 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:42.104165 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:42.104298 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 10:48:42.104373 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:48:42.107863 10376 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2df577cea0342e98b29c0eee0b5b9d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36541 } }
I20260807 10:48:42.108420 10376 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:42.108520 10376 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2df577cea0342e98b29c0eee0b5b9d7, State: Initialized, Role: FOLLOWER
I20260807 10:48:42.109232 10376 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2df577cea0342e98b29c0eee0b5b9d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36541 } }
I20260807 10:48:42.109534 10376 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:42.109696 10376 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:42.109869 10376 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:42.112735 10376 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2df577cea0342e98b29c0eee0b5b9d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36541 } }
I20260807 10:48:42.113411 10376 leader_election.cc:302] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2df577cea0342e98b29c0eee0b5b9d7; no voters:
I20260807 10:48:42.114166 10376 leader_election.cc:288] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:42.114317 10392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:42.115085 10392 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [term 1 LEADER]: Becoming Leader. State: Replica: e2df577cea0342e98b29c0eee0b5b9d7, State: Running, Role: LEADER
I20260807 10:48:42.115873 10392 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2df577cea0342e98b29c0eee0b5b9d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36541 } }
I20260807 10:48:42.117072 10376 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:42.119011 10395 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2df577cea0342e98b29c0eee0b5b9d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2df577cea0342e98b29c0eee0b5b9d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36541 } } }
I20260807 10:48:42.119508 10395 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:42.119405 10394 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2df577cea0342e98b29c0eee0b5b9d7. Latest consensus state: current_term: 1 leader_uuid: "e2df577cea0342e98b29c0eee0b5b9d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2df577cea0342e98b29c0eee0b5b9d7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36541 } } }
I20260807 10:48:42.119846 10394 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:42.122315 10402 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:42.128988 10402 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:42.141425 10402 catalog_manager.cc:1347] Generated new cluster ID: 2d9a4e4516de4be28193e96dcb5f6dd1
I20260807 10:48:42.141626 10402 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:42.162386 10402 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:42.164503 10402 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:42.189119 10402 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2df577cea0342e98b29c0eee0b5b9d7: Generated new TSK 0
I20260807 10:48:42.190495 10402 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:42.205660 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 10287
W20260807 10:48:42.207573 10370 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.33:35957
W20260807 10:48:42.208591 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 10287: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:48:42.208760 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 10287
W20260807 10:48:42.240705 10264 connection.cc:535] client connection to 127.0.0.1:36541 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36541): Connection reset by peer (error 104)
2026-08-07T10:48:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (3209 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:42 dist-test-slave-42z9 krb5kdc[10419](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:42 dist-test-slave-42z9 krb5kdc[10419](info): set up 2 sockets
Aug 07 10:48:42 dist-test-slave-42z9 krb5kdc[10419](info): commencing operation
krb5kdc: starting...
W20260807 10:48:43.492745 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.000s sys 0.072s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:43 dist-test-slave-42z9 krb5kdc[10419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:43.912330 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41279
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:44.307124 10445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:44.307538 10445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:44.307648 10445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:44.315531 10445 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:44.315687 10445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:44.315752 10445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:44.315816 10445 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:44.315862 10445 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:44.327034 10445 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:44.328577 10445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:44.330118 10445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:44.343022 10451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:44.343108 10452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:44.343127 10454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:44.343990 10445 server_base.cc:1034] running on GCE node
I20260807 10:48:44.344882 10445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:44.346558 10445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:44.347797 10445 hybrid_clock.cc:648] HybridClock initialized: now 1786099724347753 us; error 37 us; skew 500 ppm
I20260807 10:48:44.348224 10445 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:44 dist-test-slave-42z9 krb5kdc[10419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099724, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:44.354966 10445 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:44.356842 10445 webserver.cc:460] Webserver started at http://127.0.0.1:36527/ using document root <none> and password file <none>
I20260807 10:48:44.357789 10445 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:44.357952 10445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:44.358306 10445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:44.361927 10445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "bb97e81131cd43029ee822c6f4c81988"
format_stamp: "Formatted at 2026-08-07 10:48:44 on dist-test-slave-42z9"
server_key: "965acb532ce422b2096a136ab71572f6"
server_key_iv: "ebc8fd240bf0db7f5e94eb836883aa6a"
server_key_version: "encryptionkey@0"
I20260807 10:48:44.362854 10445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "bb97e81131cd43029ee822c6f4c81988"
format_stamp: "Formatted at 2026-08-07 10:48:44 on dist-test-slave-42z9"
server_key: "965acb532ce422b2096a136ab71572f6"
server_key_iv: "ebc8fd240bf0db7f5e94eb836883aa6a"
server_key_version: "encryptionkey@0"
I20260807 10:48:44.369275 10445 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 10:48:44.373792 10464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:44.375463 10445 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 10:48:44.375671 10445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "bb97e81131cd43029ee822c6f4c81988"
format_stamp: "Formatted at 2026-08-07 10:48:44 on dist-test-slave-42z9"
server_key: "965acb532ce422b2096a136ab71572f6"
server_key_iv: "ebc8fd240bf0db7f5e94eb836883aa6a"
server_key_version: "encryptionkey@0"
I20260807 10:48:44.375902 10445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:44.382491 10445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:44.387437 10445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:44.387779 10445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:44.407968 10445 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41279
I20260807 10:48:44.408020 10540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41279 every 8 connection(s)
I20260807 10:48:44.409626 10445 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:44.413998 10541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:44.414616 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 10445
I20260807 10:48:44.414808 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:44.415385 11450 external_mini_cluster.cc:1428] Setting key bc70e17906ce0898234039409d3f58dc
I20260807 10:48:44.425017 10544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:44.417595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:37229 (local address 127.0.0.1:41279)
0807 10:48:44.418640 (+ 1045us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:44.418655 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:44.418708 (+ 53us) server_negotiation.cc:407] Connection header received
0807 10:48:44.421132 (+ 2424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:44.421167 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:44.421684 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:44.422108 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:44.423293 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:44.423301 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:44.423316 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:44.423333 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:44.423399 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:44.423425 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:44.423620 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:44.423738 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 10:48:44.423961 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":767,"thread_start_us":479,"threads_started":1}
I20260807 10:48:44.428867 10541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988: Bootstrap starting.
I20260807 10:48:44.429136 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:44.433326 10541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:44.434923 10541 log.cc:824] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:44.437568 10544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:44.434888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:58579 (local address 127.0.0.1:41279)
0807 10:48:44.435199 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:44.435206 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:44.435421 (+ 215us) server_negotiation.cc:407] Connection header received
0807 10:48:44.435692 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:44.435699 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:44.435779 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:44.435902 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:44.436894 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:44.436898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:44.436901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:44.436918 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:44.436961 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:44.436977 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:44.437088 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:44.437186 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 10:48:44.437240 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 10:48:44.438910 10541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988: No bootstrap required, opened a new log
I20260807 10:48:44.447181 10541 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb97e81131cd43029ee822c6f4c81988" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41279 } }
I20260807 10:48:44.447654 10541 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:44.447741 10541 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb97e81131cd43029ee822c6f4c81988, State: Initialized, Role: FOLLOWER
I20260807 10:48:44.448365 10541 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb97e81131cd43029ee822c6f4c81988" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41279 } }
I20260807 10:48:44.448617 10541 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:44.448732 10541 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:44.448868 10541 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:44.451356 10541 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb97e81131cd43029ee822c6f4c81988" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41279 } }
I20260807 10:48:44.451938 10541 leader_election.cc:302] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb97e81131cd43029ee822c6f4c81988; no voters:
I20260807 10:48:44.452700 10541 leader_election.cc:288] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:44.452828 10556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:44.454145 10556 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [term 1 LEADER]: Becoming Leader. State: Replica: bb97e81131cd43029ee822c6f4c81988, State: Running, Role: LEADER
I20260807 10:48:44.454737 10556 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb97e81131cd43029ee822c6f4c81988" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41279 } }
I20260807 10:48:44.455349 10541 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:44.457826 10557 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb97e81131cd43029ee822c6f4c81988" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb97e81131cd43029ee822c6f4c81988" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41279 } } }
I20260807 10:48:44.458293 10557 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:44.457795 10558 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb97e81131cd43029ee822c6f4c81988. Latest consensus state: current_term: 1 leader_uuid: "bb97e81131cd43029ee822c6f4c81988" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb97e81131cd43029ee822c6f4c81988" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41279 } } }
I20260807 10:48:44.458613 10558 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:44.462148 10564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:44.468420 10564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:44.479017 10564 catalog_manager.cc:1347] Generated new cluster ID: 35ee9e056bf542db8906bad6e122834b
I20260807 10:48:44.479176 10564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:44.526497 10564 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:44.527019 10564 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:44.535470 10564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb97e81131cd43029ee822c6f4c81988: Generated new TSK 0
I20260807 10:48:44.536491 10564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:44.543094 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 10445
W20260807 10:48:44.545131 10535 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.33:37229
W20260807 10:48:44.546077 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 10445: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:48:44.546260 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 10445
2026-08-07T10:48:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2335 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:44 dist-test-slave-42z9 krb5kdc[10587](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:44 dist-test-slave-42z9 krb5kdc[10587](info): set up 2 sockets
Aug 07 10:48:44 dist-test-slave-42z9 krb5kdc[10587](info): commencing operation
krb5kdc: starting...
W20260807 10:48:45.824754 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.004s sys 0.067s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:46 dist-test-slave-42z9 krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:46.229007 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46837
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:46.617583 10605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:46.617928 10605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:46.618049 10605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:46.625736 10605 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:46.625874 10605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:46.625931 10605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:46.625994 10605 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:46.626039 10605 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:46.636528 10605 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46837
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:46.638053 10605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:46.639513 10605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:46.652230 10613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:46.652134 10620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:46.652169 10615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:46.654883 10605 server_base.cc:1034] running on GCE node
I20260807 10:48:46.655797 10605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:46.657503 10605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:46.658741 10605 hybrid_clock.cc:648] HybridClock initialized: now 1786099726658691 us; error 42 us; skew 500 ppm
I20260807 10:48:46.659142 10605 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:46 dist-test-slave-42z9 krb5kdc[10587](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099726, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:46.662518 10605 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:46.664215 10605 webserver.cc:460] Webserver started at http://127.0.0.1:38183/ using document root <none> and password file <none>
I20260807 10:48:46.664996 10605 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:46.665108 10605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:46.665402 10605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:46.669152 10605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "e36d5669a23c4fd9a2eb852d38b5436c"
format_stamp: "Formatted at 2026-08-07 10:48:46 on dist-test-slave-42z9"
server_key: "76a5e28b3a6edf131bade6af33c8704c"
server_key_iv: "217052cce8f3d7a801d8fff8483cf794"
server_key_version: "encryptionkey@0"
I20260807 10:48:46.670187 10605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "e36d5669a23c4fd9a2eb852d38b5436c"
format_stamp: "Formatted at 2026-08-07 10:48:46 on dist-test-slave-42z9"
server_key: "76a5e28b3a6edf131bade6af33c8704c"
server_key_iv: "217052cce8f3d7a801d8fff8483cf794"
server_key_version: "encryptionkey@0"
I20260807 10:48:46.676225 10605 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:48:46.680356 10636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:46.682041 10605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 10:48:46.682245 10605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "e36d5669a23c4fd9a2eb852d38b5436c"
format_stamp: "Formatted at 2026-08-07 10:48:46 on dist-test-slave-42z9"
server_key: "76a5e28b3a6edf131bade6af33c8704c"
server_key_iv: "217052cce8f3d7a801d8fff8483cf794"
server_key_version: "encryptionkey@0"
I20260807 10:48:46.682479 10605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:46.702896 10605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:46.707931 10605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:46.708261 10605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:46.727638 10605 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46837
I20260807 10:48:46.727679 10711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46837 every 8 connection(s)
I20260807 10:48:46.729144 10605 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:46.730798 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 10605
I20260807 10:48:46.731004 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:46.731597 11450 external_mini_cluster.cc:1428] Setting key 5c8fc8a11044f5393187cc8519e25a66
I20260807 10:48:46.734364 10712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:48:46 dist-test-slave-42z9 krb5kdc[10587](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 10:48:46.749357 10712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c: Bootstrap starting.
I20260807 10:48:46.753206 10712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:46.754748 10712 log.cc:824] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:46.758749 10715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:46.733634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:58015 (local address 127.0.0.1:46837)
0807 10:48:46.734500 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:46.734517 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:46.734588 (+ 71us) server_negotiation.cc:407] Connection header received
0807 10:48:46.736996 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:46.737030 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:46.737702 (+ 672us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:46.738243 (+ 541us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:46.739822 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:46.742067 (+ 2245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:46.743557 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:46.744667 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:46.744883 (+ 216us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:46.749841 (+ 4958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:46.749852 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:46.749871 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:46.749921 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:46.753113 (+ 3192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:46.754444 (+ 1331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:46.754455 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:46.754466 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:46.754703 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:46.755310 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:46.755314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:46.755317 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:46.756259 (+ 942us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:46.756644 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:46.757186 (+ 542us) server_negotiation.cc:299] Negotiation successful
0807 10:48:46.757599 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":336,"threads_started":1}
I20260807 10:48:46.758811 10712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c: No bootstrap required, opened a new log
I20260807 10:48:46.763693 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:46.770383 10712 raft_consensus.cc:348] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e36d5669a23c4fd9a2eb852d38b5436c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } }
I20260807 10:48:46.770927 10712 raft_consensus.cc:374] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:46.771063 10712 raft_consensus.cc:729] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36d5669a23c4fd9a2eb852d38b5436c, State: Initialized, Role: FOLLOWER
I20260807 10:48:46.771739 10712 consensus_queue.cc:260] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e36d5669a23c4fd9a2eb852d38b5436c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } }
I20260807 10:48:46.771998 10712 raft_consensus.cc:388] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:46.772140 10712 raft_consensus.cc:482] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:46.772305 10712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:46.775363 10712 raft_consensus.cc:504] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e36d5669a23c4fd9a2eb852d38b5436c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } }
I20260807 10:48:46.776015 10712 leader_election.cc:302] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e36d5669a23c4fd9a2eb852d38b5436c; no voters:
I20260807 10:48:46.776698 10712 leader_election.cc:288] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:46.776806 10723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:46.778142 10723 raft_consensus.cc:686] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [term 1 LEADER]: Becoming Leader. State: Replica: e36d5669a23c4fd9a2eb852d38b5436c, State: Running, Role: LEADER
I20260807 10:48:46.778890 10723 consensus_queue.cc:237] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e36d5669a23c4fd9a2eb852d38b5436c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } }
I20260807 10:48:46.779385 10712 sys_catalog.cc:564] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:46.782172 10724 sys_catalog.cc:455] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e36d5669a23c4fd9a2eb852d38b5436c. Latest consensus state: current_term: 1 leader_uuid: "e36d5669a23c4fd9a2eb852d38b5436c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e36d5669a23c4fd9a2eb852d38b5436c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } } }
I20260807 10:48:46.782624 10724 sys_catalog.cc:458] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:46.784701 10725 sys_catalog.cc:455] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e36d5669a23c4fd9a2eb852d38b5436c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e36d5669a23c4fd9a2eb852d38b5436c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46837 } } }
I20260807 10:48:46.785061 10725 sys_catalog.cc:458] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:46.788244 10715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:46.770010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:53621 (local address 127.0.0.1:46837)
0807 10:48:46.770232 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:46.770238 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:46.770666 (+ 428us) server_negotiation.cc:407] Connection header received
0807 10:48:46.770820 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:46.770826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:46.770926 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:46.771060 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:46.772808 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:46.774053 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:46.775407 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:46.775946 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:46.776036 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:46.779464 (+ 3428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:46.779471 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:46.779476 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:46.779524 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:46.783096 (+ 3572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:46.784275 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:46.784285 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:46.784289 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:46.784535 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:46.785210 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:46.785216 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:46.785220 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:46.785679 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:46.787318 (+ 1639us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:46.787535 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 10:48:46.787749 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 10:48:46.788861 10732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:46.794085 10732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:46.804778 10732 catalog_manager.cc:1347] Generated new cluster ID: ea03811295b44dfd9889454e15218f2d
I20260807 10:48:46.804912 10732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:46.834406 10732 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:46.836516 10732 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:46.846129 10732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e36d5669a23c4fd9a2eb852d38b5436c: Generated new TSK 0
I20260807 10:48:46.847332 10732 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:46.861907 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 10605
I20260807 10:48:46.863152 10704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:46.959498 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 10605
W20260807 10:48:46.989248 10585 connection.cc:535] client connection to 127.0.0.1:46837 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46837): Connection reset by peer (error 104)
2026-08-07T10:48:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2418 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:47 dist-test-slave-42z9 krb5kdc[10756](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:47 dist-test-slave-42z9 krb5kdc[10756](info): set up 2 sockets
Aug 07 10:48:47 dist-test-slave-42z9 krb5kdc[10756](info): commencing operation
krb5kdc: starting...
W20260807 10:48:48.239203 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.068s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:48 dist-test-slave-42z9 krb5kdc[10756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:48.649508 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34987
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:49.045730 10774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:49.046130 10774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:49.046291 10774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:49.054252 10774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:49.054422 10774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:49.054512 10774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:49.054606 10774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:49.054680 10774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:49.065793 10774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34987
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:49.067365 10774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:49.068868 10774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:49.082298 10783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:49.082384 10787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:49.082384 10785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:49.083436 10774 server_base.cc:1034] running on GCE node
I20260807 10:48:49.084409 10774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:49.086297 10774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:49.087589 10774 hybrid_clock.cc:648] HybridClock initialized: now 1786099729087520 us; error 73 us; skew 500 ppm
I20260807 10:48:49.088156 10774 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:49 dist-test-slave-42z9 krb5kdc[10756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099729, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:49.092206 10774 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:49.094306 10774 webserver.cc:460] Webserver started at http://127.0.0.1:45247/ using document root <none> and password file <none>
I20260807 10:48:49.095216 10774 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:49.095381 10774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:49.095753 10774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:49.099431 10774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "93c47045526947fea97c79ab3d65222f"
format_stamp: "Formatted at 2026-08-07 10:48:49 on dist-test-slave-42z9"
server_key: "42f575d8fbd35df1482ec576c211173f"
server_key_iv: "cd5040cde733f245093fe11ad7a737df"
server_key_version: "encryptionkey@0"
I20260807 10:48:49.100430 10774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "93c47045526947fea97c79ab3d65222f"
format_stamp: "Formatted at 2026-08-07 10:48:49 on dist-test-slave-42z9"
server_key: "42f575d8fbd35df1482ec576c211173f"
server_key_iv: "cd5040cde733f245093fe11ad7a737df"
server_key_version: "encryptionkey@0"
I20260807 10:48:49.107158 10774 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.007s
I20260807 10:48:49.111805 10795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:49.113615 10774 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 10:48:49.113850 10774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "93c47045526947fea97c79ab3d65222f"
format_stamp: "Formatted at 2026-08-07 10:48:49 on dist-test-slave-42z9"
server_key: "42f575d8fbd35df1482ec576c211173f"
server_key_iv: "cd5040cde733f245093fe11ad7a737df"
server_key_version: "encryptionkey@0"
I20260807 10:48:49.114106 10774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:49.129973 10774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:49.135258 10774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:49.135581 10774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:49.159421 10774 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34987
I20260807 10:48:49.159421 10866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34987 every 8 connection(s)
I20260807 10:48:49.161266 10774 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:49.163223 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 10774
I20260807 10:48:49.163416 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:49.163887 11450 external_mini_cluster.cc:1428] Setting key 68df5ff2d1f977db6204ef5ce83b3d15
I20260807 10:48:49.166970 10867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:49.178840 10870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:49.166032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:41163 (local address 127.0.0.1:34987)
0807 10:48:49.166934 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:49.166948 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:49.166998 (+ 50us) server_negotiation.cc:407] Connection header received
0807 10:48:49.168819 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:49.168845 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:49.169314 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:49.169772 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:49.170415 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:49.172288 (+ 1873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:49.173811 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:49.174592 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:49.174808 (+ 216us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:49.176170 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:49.176183 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:49.176202 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:49.176844 (+ 642us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:49.176939 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:49.176971 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:49.177167 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:49.177531 (+ 364us) server_negotiation.cc:299] Negotiation successful
0807 10:48:49.177732 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":408,"threads_started":1}
I20260807 10:48:49.179977 10867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f: Bootstrap starting.
I20260807 10:48:49.183652 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:49.184286 10867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:49.185660 10867 log.cc:824] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:49.189291 10867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f: No bootstrap required, opened a new log
I20260807 10:48:49.196825 10870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:49.188622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:43355 (local address 127.0.0.1:34987)
0807 10:48:49.188906 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:49.188914 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:49.189510 (+ 596us) server_negotiation.cc:407] Connection header received
0807 10:48:49.189734 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:49.189740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:49.189834 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:49.189976 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:49.190501 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:49.191648 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:49.193865 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:49.194411 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:49.194530 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:49.195943 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:49.195949 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:49.195952 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:49.195979 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:49.196027 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:49.196046 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:49.196151 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:49.196365 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 10:48:49.196427 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 10:48:49.200229 10867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93c47045526947fea97c79ab3d65222f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34987 } }
I20260807 10:48:49.200700 10867 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:49.200814 10867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93c47045526947fea97c79ab3d65222f, State: Initialized, Role: FOLLOWER
I20260807 10:48:49.201505 10867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93c47045526947fea97c79ab3d65222f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34987 } }
I20260807 10:48:49.201828 10867 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:49.201982 10867 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:49.202175 10867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:49.204943 10867 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93c47045526947fea97c79ab3d65222f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34987 } }
I20260807 10:48:49.205638 10867 leader_election.cc:302] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93c47045526947fea97c79ab3d65222f; no voters:
I20260807 10:48:49.206363 10867 leader_election.cc:288] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:49.206493 10878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:49.207195 10878 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [term 1 LEADER]: Becoming Leader. State: Replica: 93c47045526947fea97c79ab3d65222f, State: Running, Role: LEADER
I20260807 10:48:49.207890 10878 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93c47045526947fea97c79ab3d65222f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34987 } }
I20260807 10:48:49.208715 10867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:49.211081 10880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93c47045526947fea97c79ab3d65222f. Latest consensus state: current_term: 1 leader_uuid: "93c47045526947fea97c79ab3d65222f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93c47045526947fea97c79ab3d65222f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34987 } } }
I20260807 10:48:49.211606 10880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:49.211658 10879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93c47045526947fea97c79ab3d65222f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93c47045526947fea97c79ab3d65222f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34987 } } }
I20260807 10:48:49.212010 10879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:49.212813 10888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:49.218621 10888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:49.233355 10888 catalog_manager.cc:1347] Generated new cluster ID: 715153b5baa1431684a9c3824aab5872
I20260807 10:48:49.233531 10888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:49.256347 10888 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:49.258179 10888 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:49.267051 10888 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93c47045526947fea97c79ab3d65222f: Generated new TSK 0
I20260807 10:48:49.268402 10888 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:49.277848 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 10774
W20260807 10:48:49.279273 10860 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.33:41163
W20260807 10:48:49.280161 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 10774: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:48:49.280352 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 10774
W20260807 10:48:49.308753 10753 connection.cc:535] client connection to 127.0.0.1:34987 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34987): Connection reset by peer (error 104)
2026-08-07T10:48:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2314 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:49 dist-test-slave-42z9 krb5kdc[10911](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:49 dist-test-slave-42z9 krb5kdc[10911](info): set up 2 sockets
Aug 07 10:48:49 dist-test-slave-42z9 krb5kdc[10911](info): commencing operation
krb5kdc: starting...
W20260807 10:48:50.555626 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.005s sys 0.065s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:50 dist-test-slave-42z9 krb5kdc[10911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099730, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 10:48:50.969257 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35421
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:51.381408 10932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:51.381844 10932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:51.381961 10932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:51.389850 10932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:51.389997 10932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:51.390045 10932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:51.390107 10932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:51.390151 10932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:51.400990 10932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35421
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:51.402558 10932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:51.404038 10932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:51.416844 10942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:51.416929 10943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:51.416903 10945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:51.417860 10932 server_base.cc:1034] running on GCE node
I20260807 10:48:51.418741 10932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:51.420472 10932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:51.421708 10932 hybrid_clock.cc:648] HybridClock initialized: now 1786099731421661 us; error 46 us; skew 500 ppm
I20260807 10:48:51.422142 10932 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:51 dist-test-slave-42z9 krb5kdc[10911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099731, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:51.425689 10932 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 10:48:51.427557 10932 webserver.cc:460] Webserver started at http://127.0.0.1:43995/ using document root <none> and password file <none>
I20260807 10:48:51.428375 10932 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:51.428505 10932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:51.428855 10932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:51.432374 10932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "4943b5945e20474486c4e94011d294ef"
format_stamp: "Formatted at 2026-08-07 10:48:51 on dist-test-slave-42z9"
server_key: "30bc38c432f24d0a1266741ac43d8bb4"
server_key_iv: "a796fcf30594fd2e944b61519d3d2319"
server_key_version: "encryptionkey@0"
I20260807 10:48:51.433310 10932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "4943b5945e20474486c4e94011d294ef"
format_stamp: "Formatted at 2026-08-07 10:48:51 on dist-test-slave-42z9"
server_key: "30bc38c432f24d0a1266741ac43d8bb4"
server_key_iv: "a796fcf30594fd2e944b61519d3d2319"
server_key_version: "encryptionkey@0"
I20260807 10:48:51.439806 10932 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:48:51.444824 10954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:51.446678 10932 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 10:48:51.446951 10932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "4943b5945e20474486c4e94011d294ef"
format_stamp: "Formatted at 2026-08-07 10:48:51 on dist-test-slave-42z9"
server_key: "30bc38c432f24d0a1266741ac43d8bb4"
server_key_iv: "a796fcf30594fd2e944b61519d3d2319"
server_key_version: "encryptionkey@0"
I20260807 10:48:51.447203 10932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:51.454154 10932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:51.459188 10932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:51.459549 10932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:51.480069 10932 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35421
I20260807 10:48:51.480101 11027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35421 every 8 connection(s)
I20260807 10:48:51.481838 10932 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:51.486514 11029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:51.492132 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 10932
I20260807 10:48:51.492342 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:51.492816 11450 external_mini_cluster.cc:1428] Setting key 1a9612ee18d86720384c5e30ee17a19e
I20260807 10:48:51.500540 11029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef: Bootstrap starting.
I20260807 10:48:51.503165 11034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:51.494951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:51185 (local address 127.0.0.1:35421)
0807 10:48:51.495934 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:51.495953 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:51.496015 (+ 62us) server_negotiation.cc:407] Connection header received
0807 10:48:51.498668 (+ 2653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:51.498705 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:51.499260 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:51.499801 (+ 541us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:51.500902 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:51.500912 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:51.500932 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:51.500952 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:51.501039 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:51.501071 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:51.501335 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:51.501506 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 10:48:51.501738 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":420,"threads_started":1}
I20260807 10:48:51.504938 11029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:51.506300 11029 log.cc:824] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:51.507732 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:51.509747 11029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef: No bootstrap required, opened a new log
I20260807 10:48:51.515225 11034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:51.512500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.33:52329 (local address 127.0.0.1:35421)
0807 10:48:51.512733 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:51.512740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:51.513099 (+ 359us) server_negotiation.cc:407] Connection header received
0807 10:48:51.513303 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:51.513307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:51.513364 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:51.513526 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:51.514483 (+ 957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:51.514488 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:51.514493 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:51.514516 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:51.514565 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:51.514581 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:51.514697 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:51.514813 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 10:48:51.514875 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 10:48:51.519366 11029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4943b5945e20474486c4e94011d294ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35421 } }
I20260807 10:48:51.519841 11029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:51.519960 11029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4943b5945e20474486c4e94011d294ef, State: Initialized, Role: FOLLOWER
I20260807 10:48:51.520615 11029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4943b5945e20474486c4e94011d294ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35421 } }
I20260807 10:48:51.520875 11029 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:51.521020 11029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:51.521195 11029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:51.523692 11029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4943b5945e20474486c4e94011d294ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35421 } }
I20260807 10:48:51.524396 11029 leader_election.cc:302] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4943b5945e20474486c4e94011d294ef; no voters:
I20260807 10:48:51.525149 11029 leader_election.cc:288] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:51.525305 11044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:51.526065 11044 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [term 1 LEADER]: Becoming Leader. State: Replica: 4943b5945e20474486c4e94011d294ef, State: Running, Role: LEADER
I20260807 10:48:51.526713 11044 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4943b5945e20474486c4e94011d294ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35421 } }
I20260807 10:48:51.527454 11029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:51.529736 11046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4943b5945e20474486c4e94011d294ef. Latest consensus state: current_term: 1 leader_uuid: "4943b5945e20474486c4e94011d294ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4943b5945e20474486c4e94011d294ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35421 } } }
I20260807 10:48:51.530917 11046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:51.530309 11045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4943b5945e20474486c4e94011d294ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4943b5945e20474486c4e94011d294ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35421 } } }
I20260807 10:48:51.532935 11045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:51.534818 11053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:51.541498 11053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:51.552815 11053 catalog_manager.cc:1347] Generated new cluster ID: 4360f3a10d7f453a9e028e851bc6f0b9
I20260807 10:48:51.552977 11053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:51.586005 11053 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:51.586661 11053 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:51.609786 11053 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4943b5945e20474486c4e94011d294ef: Generated new TSK 0
I20260807 10:48:51.610977 11053 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:51.619530 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 10932
W20260807 10:48:51.620844 11022 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.33:51185
W20260807 10:48:51.621743 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 10932: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:48:51.621919 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 10932
2026-08-07T10:48:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2344 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:51 dist-test-slave-42z9 krb5kdc[11072](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:51 dist-test-slave-42z9 krb5kdc[11072](info): set up 2 sockets
Aug 07 10:48:51 dist-test-slave-42z9 krb5kdc[11072](info): commencing operation
krb5kdc: starting...
W20260807 10:48:52.907534 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.000s sys 0.072s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:53 dist-test-slave-42z9 krb5kdc[11072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:48:53.328790 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:46781
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:36731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:46781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:53.736498 11087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:53.736879 11087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:53.736982 11087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:53.744969 11087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:53.745141 11087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:53.745193 11087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:53.745260 11087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:53.745306 11087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:53.756278 11087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:36731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:46781
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:46781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:53.757808 11087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:53.759253 11087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:53.772816 11092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:53.772802 11100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:53.773002 11097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:53.773788 11087 server_base.cc:1034] running on GCE node
I20260807 10:48:53.774756 11087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:53.776540 11087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:53.777783 11087 hybrid_clock.cc:648] HybridClock initialized: now 1786099733777731 us; error 44 us; skew 500 ppm
I20260807 10:48:53.778239 11087 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:53 dist-test-slave-42z9 krb5kdc[11072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099733, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:53.781848 11087 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:48:53.783706 11087 webserver.cc:460] Webserver started at http://127.11.46.190:33039/ using document root <none> and password file <none>
I20260807 10:48:53.784564 11087 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:53.784746 11087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:53.785151 11087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:53.788694 11087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "e888b6b95f454507aa702780557fd7d7"
format_stamp: "Formatted at 2026-08-07 10:48:53 on dist-test-slave-42z9"
server_key: "d9264da374f00eb0e61ebd364a92d726"
server_key_iv: "92c3ca64da3966bcab2aff5e0c570401"
server_key_version: "encryptionkey@0"
I20260807 10:48:53.789723 11087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "e888b6b95f454507aa702780557fd7d7"
format_stamp: "Formatted at 2026-08-07 10:48:53 on dist-test-slave-42z9"
server_key: "d9264da374f00eb0e61ebd364a92d726"
server_key_iv: "92c3ca64da3966bcab2aff5e0c570401"
server_key_version: "encryptionkey@0"
I20260807 10:48:53.796135 11087 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:48:53.800526 11113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:53.802261 11087 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 10:48:53.802492 11087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "e888b6b95f454507aa702780557fd7d7"
format_stamp: "Formatted at 2026-08-07 10:48:53 on dist-test-slave-42z9"
server_key: "d9264da374f00eb0e61ebd364a92d726"
server_key_iv: "92c3ca64da3966bcab2aff5e0c570401"
server_key_version: "encryptionkey@0"
I20260807 10:48:53.802760 11087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:53.819988 11087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:53.825038 11087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:53.825364 11087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:53.846333 11087 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:46781
I20260807 10:48:53.846369 11190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:46781 every 8 connection(s)
I20260807 10:48:53.848001 11087 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:53.852766 11191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:53.853950 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 11087
I20260807 10:48:53.854172 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:53.854799 11450 external_mini_cluster.cc:1428] Setting key f30c67895eda249acc34971c60b8fd0c
I20260807 10:48:53.869593 11191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7: Bootstrap starting.
Aug 07 10:48:53 dist-test-slave-42z9 krb5kdc[11072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:48:53.874300 11191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:53.875656 11191 log.cc:824] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:53.879837 11191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7: No bootstrap required, opened a new log
I20260807 10:48:53.882893 11194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:53.856951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39593 (local address 127.11.46.190:46781)
0807 10:48:53.857925 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:53.857939 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:53.857989 (+ 50us) server_negotiation.cc:407] Connection header received
0807 10:48:53.860170 (+ 2181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:53.860208 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:53.860810 (+ 602us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:53.861242 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:53.863498 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:53.864989 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:53.867046 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:53.867930 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:53.868107 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:53.873748 (+ 5641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:53.873759 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:53.873779 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:53.873841 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:53.877664 (+ 3823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:53.878990 (+ 1326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:53.878998 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:53.879006 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:53.879196 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:53.879738 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:53.879741 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:53.879744 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:53.880385 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:53.880689 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:53.881227 (+ 538us) server_negotiation.cc:299] Negotiation successful
0807 10:48:53.881611 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":457,"threads_started":1}
I20260807 10:48:53.887782 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:53.889519 11191 raft_consensus.cc:348] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e888b6b95f454507aa702780557fd7d7" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46781 } }
I20260807 10:48:53.890142 11191 raft_consensus.cc:374] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:53.890264 11191 raft_consensus.cc:729] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e888b6b95f454507aa702780557fd7d7, State: Initialized, Role: FOLLOWER
I20260807 10:48:53.891101 11191 consensus_queue.cc:260] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e888b6b95f454507aa702780557fd7d7" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46781 } }
I20260807 10:48:53.891481 11191 raft_consensus.cc:388] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:53.891671 11191 raft_consensus.cc:482] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:53.891877 11191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:53.895421 11191 raft_consensus.cc:504] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e888b6b95f454507aa702780557fd7d7" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46781 } }
I20260807 10:48:53.896265 11191 leader_election.cc:302] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e888b6b95f454507aa702780557fd7d7; no voters:
I20260807 10:48:53.897069 11191 leader_election.cc:288] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:53.897225 11204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:53.898458 11204 raft_consensus.cc:686] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [term 1 LEADER]: Becoming Leader. State: Replica: e888b6b95f454507aa702780557fd7d7, State: Running, Role: LEADER
I20260807 10:48:53.899307 11204 consensus_queue.cc:237] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e888b6b95f454507aa702780557fd7d7" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46781 } }
I20260807 10:48:53.899804 11191 sys_catalog.cc:564] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:53.902595 11206 sys_catalog.cc:455] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e888b6b95f454507aa702780557fd7d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e888b6b95f454507aa702780557fd7d7" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46781 } } }
I20260807 10:48:53.903053 11206 sys_catalog.cc:458] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:53.906672 11207 sys_catalog.cc:455] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e888b6b95f454507aa702780557fd7d7. Latest consensus state: current_term: 1 leader_uuid: "e888b6b95f454507aa702780557fd7d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e888b6b95f454507aa702780557fd7d7" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 46781 } } }
I20260807 10:48:53.907171 11207 sys_catalog.cc:458] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:53.907938 11212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:53.916034 11194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:53.893787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55997 (local address 127.11.46.190:46781)
0807 10:48:53.894019 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:53.894025 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:53.894645 (+ 620us) server_negotiation.cc:407] Connection header received
0807 10:48:53.894825 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:53.894830 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:53.894902 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:53.895001 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:53.897105 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:53.898610 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:53.900636 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:53.901365 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:53.901566 (+ 201us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:53.906150 (+ 4584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:53.906160 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:53.906170 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:48:53.906238 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:53.910602 (+ 4364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:53.911962 (+ 1360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:53.911969 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:53.911973 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:53.912156 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:48:53.912800 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:48:53.912806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:48:53.912810 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:48:53.913377 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:53.915091 (+ 1714us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:53.915308 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 10:48:53.915576 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 10:48:53.920547 11212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:53.932031 11212 catalog_manager.cc:1347] Generated new cluster ID: c0ff7ece7b2e41a5b6ecb5d878c765b6
I20260807 10:48:53.932195 11212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:53.945215 11212 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:53.946686 11212 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:53.957734 11212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e888b6b95f454507aa702780557fd7d7: Generated new TSK 0
I20260807 10:48:53.959146 11212 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:53.974259 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11087
I20260807 10:48:53.975827 11185 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:48:54.072460 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 11087
W20260807 10:48:54.103140 11070 connection.cc:535] client connection to 127.11.46.190:46781 recv error: Network error: failed to read from TLS socket (remote: 127.11.46.190:46781): Connection reset by peer (error 104)
2026-08-07T10:48:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:54 dist-test-slave-42z9 krb5kdc[11244](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:54 dist-test-slave-42z9 krb5kdc[11244](info): set up 2 sockets
Aug 07 10:48:54 dist-test-slave-42z9 krb5kdc[11244](info): commencing operation
krb5kdc: starting...
W20260807 10:48:55.349215 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.072s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:55 dist-test-slave-42z9 krb5kdc[11244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:48:55.763077 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:34775
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:46731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:34775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:56.154311 11261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:56.154664 11261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:56.154773 11261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:56.162441 11261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:56.162586 11261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:56.162635 11261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:56.162698 11261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:56.162742 11261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:56.173602 11261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:46731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:34775
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:34775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:56.175145 11261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:56.176666 11261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:56.190580 11269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:56.190580 11274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:56.190536 11271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:56.191562 11261 server_base.cc:1034] running on GCE node
I20260807 10:48:56.192497 11261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:56.194324 11261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:56.195634 11261 hybrid_clock.cc:648] HybridClock initialized: now 1786099736195545 us; error 68 us; skew 500 ppm
I20260807 10:48:56.196116 11261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:56 dist-test-slave-42z9 krb5kdc[11244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099736, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:56.202558 11261 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:48:56.204661 11261 webserver.cc:460] Webserver started at http://127.11.46.190:36757/ using document root <none> and password file <none>
I20260807 10:48:56.205586 11261 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:56.205737 11261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:56.206085 11261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:56.209597 11261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "e218f1ea29e74b87bd504851e2adafd4"
format_stamp: "Formatted at 2026-08-07 10:48:56 on dist-test-slave-42z9"
server_key: "9efd7aa10fa2af5b4096f62c1694900e"
server_key_iv: "e7fcca3f2c13fab4b571099ce1564c03"
server_key_version: "encryptionkey@0"
I20260807 10:48:56.210523 11261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "e218f1ea29e74b87bd504851e2adafd4"
format_stamp: "Formatted at 2026-08-07 10:48:56 on dist-test-slave-42z9"
server_key: "9efd7aa10fa2af5b4096f62c1694900e"
server_key_iv: "e7fcca3f2c13fab4b571099ce1564c03"
server_key_version: "encryptionkey@0"
I20260807 10:48:56.217345 11261 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 10:48:56.222066 11285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:56.223713 11261 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 10:48:56.223927 11261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "e218f1ea29e74b87bd504851e2adafd4"
format_stamp: "Formatted at 2026-08-07 10:48:56 on dist-test-slave-42z9"
server_key: "9efd7aa10fa2af5b4096f62c1694900e"
server_key_iv: "e7fcca3f2c13fab4b571099ce1564c03"
server_key_version: "encryptionkey@0"
I20260807 10:48:56.224164 11261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:56.245977 11261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:56.250787 11261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:56.251113 11261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:56.271539 11261 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:34775
I20260807 10:48:56.271546 11352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:34775 every 8 connection(s)
I20260807 10:48:56.274202 11261 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:56.276554 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 11261
I20260807 10:48:56.276774 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:56.277380 11450 external_mini_cluster.cc:1428] Setting key b4d7508b258885716abcdc063cbeba24
I20260807 10:48:56.279986 11353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:56.292886 11359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:56.279610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49313 (local address 127.11.46.190:34775)
0807 10:48:56.280515 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:56.280528 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:56.280580 (+ 52us) server_negotiation.cc:407] Connection header received
0807 10:48:56.282401 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:56.282431 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:56.282913 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:56.283334 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:56.284059 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:56.285578 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:56.287525 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:56.288293 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:56.288453 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:56.290019 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:56.290028 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:56.290046 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:56.290712 (+ 666us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:56.290805 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:56.290840 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:56.290997 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:56.291389 (+ 392us) server_negotiation.cc:299] Negotiation successful
0807 10:48:56.291619 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":395,"threads_started":1}
I20260807 10:48:56.294866 11353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4: Bootstrap starting.
I20260807 10:48:56.297986 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:56.299132 11353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:56.300697 11353 log.cc:824] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:56.304421 11353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4: No bootstrap required, opened a new log
I20260807 10:48:56.312115 11359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:56.303791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40441 (local address 127.11.46.190:34775)
0807 10:48:56.303989 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:56.303996 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:56.304301 (+ 305us) server_negotiation.cc:407] Connection header received
0807 10:48:56.304504 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:56.304511 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:56.304597 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:56.304717 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:56.305288 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:56.306453 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:56.308114 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:48:56.309076 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:48:56.309238 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:48:56.311071 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:56.311079 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:56.311084 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:56.311113 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:56.311201 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:56.311230 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:56.311385 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:56.311649 (+ 264us) server_negotiation.cc:299] Negotiation successful
0807 10:48:56.311724 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:48:56.315346 11353 raft_consensus.cc:348] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e218f1ea29e74b87bd504851e2adafd4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 34775 } }
I20260807 10:48:56.315840 11353 raft_consensus.cc:374] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:56.315968 11353 raft_consensus.cc:729] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e218f1ea29e74b87bd504851e2adafd4, State: Initialized, Role: FOLLOWER
I20260807 10:48:56.316618 11353 consensus_queue.cc:260] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e218f1ea29e74b87bd504851e2adafd4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 34775 } }
I20260807 10:48:56.316876 11353 raft_consensus.cc:388] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:56.317034 11353 raft_consensus.cc:482] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:56.317207 11353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:56.319774 11353 raft_consensus.cc:504] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e218f1ea29e74b87bd504851e2adafd4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 34775 } }
I20260807 10:48:56.320418 11353 leader_election.cc:302] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e218f1ea29e74b87bd504851e2adafd4; no voters:
I20260807 10:48:56.321082 11353 leader_election.cc:288] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:56.321260 11369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:56.322098 11369 raft_consensus.cc:686] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [term 1 LEADER]: Becoming Leader. State: Replica: e218f1ea29e74b87bd504851e2adafd4, State: Running, Role: LEADER
I20260807 10:48:56.322754 11369 consensus_queue.cc:237] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e218f1ea29e74b87bd504851e2adafd4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 34775 } }
I20260807 10:48:56.323640 11353 sys_catalog.cc:564] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:56.325911 11370 sys_catalog.cc:455] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e218f1ea29e74b87bd504851e2adafd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e218f1ea29e74b87bd504851e2adafd4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 34775 } } }
I20260807 10:48:56.326412 11370 sys_catalog.cc:458] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:56.327446 11378 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:56.327255 11372 sys_catalog.cc:455] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e218f1ea29e74b87bd504851e2adafd4. Latest consensus state: current_term: 1 leader_uuid: "e218f1ea29e74b87bd504851e2adafd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e218f1ea29e74b87bd504851e2adafd4" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 34775 } } }
I20260807 10:48:56.328686 11372 sys_catalog.cc:458] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4 [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:56.335024 11378 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:56.346699 11378 catalog_manager.cc:1347] Generated new cluster ID: 08d338b7d7e54f19b0fc8a4e13f5f061
I20260807 10:48:56.346856 11378 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:56.381019 11378 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:56.383177 11378 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:56.396023 11378 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e218f1ea29e74b87bd504851e2adafd4: Generated new TSK 0
I20260807 10:48:56.397289 11378 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:56.406675 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11261
W20260807 10:48:56.408634 11346 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49313
W20260807 10:48:56.409649 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11261: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:48:56.409848 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 11261
W20260807 10:48:56.445758 11242 connection.cc:535] client connection to 127.11.46.190:34775 recv error: Network error: failed to read from TLS socket (remote: 127.11.46.190:34775): Connection reset by peer (error 104)
2026-08-07T10:48:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2342 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:56 dist-test-slave-42z9 krb5kdc[11403](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:56 dist-test-slave-42z9 krb5kdc[11403](info): set up 2 sockets
Aug 07 10:48:56 dist-test-slave-42z9 krb5kdc[11403](info): commencing operation
krb5kdc: starting...
W20260807 10:48:57.704175 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.003s sys 0.070s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:48:57 dist-test-slave-42z9 krb5kdc[11403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:48:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:48:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:48:58.129329 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36723
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:36723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:48:58.524852 11424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:48:58.525216 11424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:48:58.525321 11424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:48:58.533190 11424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:48:58.533351 11424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:48:58.533402 11424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:48:58.533496 11424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:48:58.533564 11424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:48:58.544541 11424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:36723
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:36723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:48:58.546141 11424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:48:58.547711 11424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:48:58.562440 11435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:58.562665 11430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:48:58.562390 11432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:48:58.563047 11424 server_base.cc:1034] running on GCE node
I20260807 10:48:58.564132 11424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:48:58.566066 11424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:48:58.567349 11424 hybrid_clock.cc:648] HybridClock initialized: now 1786099738567288 us; error 57 us; skew 500 ppm
I20260807 10:48:58.567791 11424 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:48:58 dist-test-slave-42z9 krb5kdc[11403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099738, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:48:58.571548 11424 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:48:58.573376 11424 webserver.cc:460] Webserver started at http://127.11.46.190:37437/ using document root <none> and password file <none>
I20260807 10:48:58.574270 11424 fs_manager.cc:359] Metadata directory not provided
I20260807 10:48:58.574404 11424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:48:58.574735 11424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:48:58.578431 11424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "de381f3c0c584e348bfcbba80889b5ae"
format_stamp: "Formatted at 2026-08-07 10:48:58 on dist-test-slave-42z9"
server_key: "0bbe86fe423a81102cd92269a827dc22"
server_key_iv: "27994145f3483fe27d166252fd85693f"
server_key_version: "encryptionkey@0"
I20260807 10:48:58.579416 11424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "de381f3c0c584e348bfcbba80889b5ae"
format_stamp: "Formatted at 2026-08-07 10:48:58 on dist-test-slave-42z9"
server_key: "0bbe86fe423a81102cd92269a827dc22"
server_key_iv: "27994145f3483fe27d166252fd85693f"
server_key_version: "encryptionkey@0"
I20260807 10:48:58.586028 11424 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 10:48:58.591094 11442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:48:58.593165 11424 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:48:58.593420 11424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "de381f3c0c584e348bfcbba80889b5ae"
format_stamp: "Formatted at 2026-08-07 10:48:58 on dist-test-slave-42z9"
server_key: "0bbe86fe423a81102cd92269a827dc22"
server_key_iv: "27994145f3483fe27d166252fd85693f"
server_key_version: "encryptionkey@0"
I20260807 10:48:58.593734 11424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:48:58.600689 11424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:48:58.605832 11424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:48:58.606143 11424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:48:58.626127 11424 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:36723
I20260807 10:48:58.626176 11528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:36723 every 8 connection(s)
I20260807 10:48:58.627771 11424 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:48:58.632198 11529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:48:58.632579 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 11424
I20260807 10:48:58.632774 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:48:58.633368 11450 external_mini_cluster.cc:1428] Setting key 2194acd46810ab3a06f30843820df608
I20260807 10:48:58.643342 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:58.635418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34251 (local address 127.11.46.190:36723)
0807 10:48:58.636408 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:58.636422 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:58.636473 (+ 51us) server_negotiation.cc:407] Connection header received
0807 10:48:58.639140 (+ 2667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:58.639176 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:58.639706 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:58.640139 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:58.641428 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:58.641472 (+ 44us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:58.641496 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:58.641530 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:58.641612 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:58.641638 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:58.641847 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:58.641958 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 10:48:58.642195 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":462,"threads_started":1}
I20260807 10:48:58.648079 11529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae: Bootstrap starting.
I20260807 10:48:58.648293 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:48:58.653100 11529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae: Neither blocks nor log segments found. Creating new log.
I20260807 10:48:58.654821 11529 log.cc:824] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae: Log is configured to *not* fsync() on all Append() calls
I20260807 10:48:58.657384 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:48:58.654660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49847 (local address 127.11.46.190:36723)
0807 10:48:58.654897 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 10:48:58.654903 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:48:58.655298 (+ 395us) server_negotiation.cc:407] Connection header received
0807 10:48:58.655532 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:48:58.655538 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:48:58.655623 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:48:58.655755 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:48:58.656736 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:48:58.656741 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:48:58.656745 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:48:58.656762 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:48:58.656805 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:48:58.656821 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:48:58.656918 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 10:48:58.657046 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 10:48:58.657100 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 10:48:58.658838 11529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae: No bootstrap required, opened a new log
I20260807 10:48:58.666828 11529 raft_consensus.cc:348] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de381f3c0c584e348bfcbba80889b5ae" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36723 } }
I20260807 10:48:58.667347 11529 raft_consensus.cc:374] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:48:58.667474 11529 raft_consensus.cc:729] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de381f3c0c584e348bfcbba80889b5ae, State: Initialized, Role: FOLLOWER
I20260807 10:48:58.668125 11529 consensus_queue.cc:260] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de381f3c0c584e348bfcbba80889b5ae" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36723 } }
I20260807 10:48:58.668375 11529 raft_consensus.cc:388] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:48:58.668515 11529 raft_consensus.cc:482] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:48:58.668684 11529 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:48:58.671133 11529 raft_consensus.cc:504] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de381f3c0c584e348bfcbba80889b5ae" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36723 } }
I20260807 10:48:58.671697 11529 leader_election.cc:302] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de381f3c0c584e348bfcbba80889b5ae; no voters:
I20260807 10:48:58.672353 11529 leader_election.cc:288] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:48:58.672499 11542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:48:58.674083 11542 raft_consensus.cc:686] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [term 1 LEADER]: Becoming Leader. State: Replica: de381f3c0c584e348bfcbba80889b5ae, State: Running, Role: LEADER
I20260807 10:48:58.674671 11542 consensus_queue.cc:237] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de381f3c0c584e348bfcbba80889b5ae" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36723 } }
I20260807 10:48:58.674885 11529 sys_catalog.cc:564] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:48:58.677783 11544 sys_catalog.cc:455] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader de381f3c0c584e348bfcbba80889b5ae. Latest consensus state: current_term: 1 leader_uuid: "de381f3c0c584e348bfcbba80889b5ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de381f3c0c584e348bfcbba80889b5ae" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36723 } } }
I20260807 10:48:58.678236 11544 sys_catalog.cc:458] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:58.678143 11543 sys_catalog.cc:455] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de381f3c0c584e348bfcbba80889b5ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de381f3c0c584e348bfcbba80889b5ae" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 36723 } } }
I20260807 10:48:58.678450 11543 sys_catalog.cc:458] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae [sys.catalog]: This master's current role is: LEADER
I20260807 10:48:58.680446 11557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:48:58.685948 11557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:48:58.696420 11557 catalog_manager.cc:1347] Generated new cluster ID: 2f93275c40d8454a87319f410bc845c9
I20260807 10:48:58.696573 11557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:48:58.723163 11557 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:48:58.723702 11557 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:48:58.743556 11557 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de381f3c0c584e348bfcbba80889b5ae: Generated new TSK 0
I20260807 10:48:58.744954 11557 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:48:58.765125 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11424
W20260807 10:48:58.766561 11518 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34251
W20260807 10:48:58.767421 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11424: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:48:58.767566 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 11424
2026-08-07T10:48:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2361 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:48:58 dist-test-slave-42z9 krb5kdc[11571](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:48:58 dist-test-slave-42z9 krb5kdc[11571](info): set up 2 sockets
Aug 07 10:48:58 dist-test-slave-42z9 krb5kdc[11571](info): commencing operation
krb5kdc: starting...
W20260807 10:49:00.058359 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.003s sys 0.070s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:49:00 dist-test-slave-42z9 krb5kdc[11571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:49:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:49:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:49:00.486203 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:38279
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:38279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:49:00.887435 11591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:49:00.887809 11591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:49:00.887910 11591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:49:00.895756 11591 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:49:00.895915 11591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:49:00.895964 11591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:49:00.896030 11591 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:49:00.896076 11591 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:49:00.907209 11591 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:38279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:38279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:49:00.908792 11591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:49:00.910315 11591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:49:00.924028 11601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:00.924081 11605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:00.923995 11599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:49:00.924966 11591 server_base.cc:1034] running on GCE node
I20260807 10:49:00.925976 11591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:49:00.927732 11591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:49:00.928996 11591 hybrid_clock.cc:648] HybridClock initialized: now 1786099740928941 us; error 57 us; skew 500 ppm
I20260807 10:49:00.929467 11591 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:49:00 dist-test-slave-42z9 krb5kdc[11571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099740, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:49:00.932987 11591 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:49:00.934933 11591 webserver.cc:460] Webserver started at http://127.11.46.190:44087/ using document root <none> and password file <none>
I20260807 10:49:00.935767 11591 fs_manager.cc:359] Metadata directory not provided
I20260807 10:49:00.935930 11591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:49:00.936282 11591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:49:00.939939 11591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "c90125bbc58c43cb82773fd5c0d4dcc3"
format_stamp: "Formatted at 2026-08-07 10:49:00 on dist-test-slave-42z9"
server_key: "ce5a4e1b6c470d85a6d9b1885d6b6d37"
server_key_iv: "2f52e1b20ea817aacda13d99a12339b2"
server_key_version: "encryptionkey@0"
I20260807 10:49:00.940877 11591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "c90125bbc58c43cb82773fd5c0d4dcc3"
format_stamp: "Formatted at 2026-08-07 10:49:00 on dist-test-slave-42z9"
server_key: "ce5a4e1b6c470d85a6d9b1885d6b6d37"
server_key_iv: "2f52e1b20ea817aacda13d99a12339b2"
server_key_version: "encryptionkey@0"
I20260807 10:49:00.947307 11591 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.006s
I20260807 10:49:00.951951 11613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:49:00.953843 11591 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 10:49:00.954090 11591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "c90125bbc58c43cb82773fd5c0d4dcc3"
format_stamp: "Formatted at 2026-08-07 10:49:00 on dist-test-slave-42z9"
server_key: "ce5a4e1b6c470d85a6d9b1885d6b6d37"
server_key_iv: "2f52e1b20ea817aacda13d99a12339b2"
server_key_version: "encryptionkey@0"
I20260807 10:49:00.954334 11591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:49:00.970834 11591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:49:00.976073 11591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:49:00.976397 11591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:49:00.997478 11591 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:38279
I20260807 10:49:00.997560 11705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:38279 every 8 connection(s)
I20260807 10:49:00.999153 11591 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:49:01.000716 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 11591
I20260807 10:49:01.000964 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:49:01.001490 11450 external_mini_cluster.cc:1428] Setting key e4706431466d27af8cf39ba27741471d
I20260807 10:49:01.005167 11706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 10:49:01 dist-test-slave-42z9 krb5kdc[11571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:49:01.020557 11706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3: Bootstrap starting.
I20260807 10:49:01.025722 11706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3: Neither blocks nor log segments found. Creating new log.
I20260807 10:49:01.027427 11706 log.cc:824] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3: Log is configured to *not* fsync() on all Append() calls
I20260807 10:49:01.030386 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:01.003686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52009 (local address 127.11.46.190:38279)
0807 10:49:01.004620 (+ 934us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:01.004642 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:01.004721 (+ 79us) server_negotiation.cc:407] Connection header received
0807 10:49:01.007240 (+ 2519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:01.007281 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:01.007925 (+ 644us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:01.008440 (+ 515us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:01.010251 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:01.012532 (+ 2281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:01.014131 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:01.015273 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:01.015495 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:01.020119 (+ 4624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:01.020135 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:01.020162 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:01.020233 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:01.024746 (+ 4513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:01.025752 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:01.025764 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:01.025775 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:01.026062 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:01.026489 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:01.026494 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:01.026497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:01.027366 (+ 869us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:01.027735 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:01.028222 (+ 487us) server_negotiation.cc:299] Negotiation successful
0807 10:49:01.028802 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":367,"threads_started":1}
I20260807 10:49:01.031610 11706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3: No bootstrap required, opened a new log
I20260807 10:49:01.035614 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:49:01.041283 11706 raft_consensus.cc:348] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90125bbc58c43cb82773fd5c0d4dcc3" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38279 } }
I20260807 10:49:01.041965 11706 raft_consensus.cc:374] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:49:01.042104 11706 raft_consensus.cc:729] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c90125bbc58c43cb82773fd5c0d4dcc3, State: Initialized, Role: FOLLOWER
I20260807 10:49:01.042802 11706 consensus_queue.cc:260] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90125bbc58c43cb82773fd5c0d4dcc3" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38279 } }
I20260807 10:49:01.043084 11706 raft_consensus.cc:388] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:49:01.043237 11706 raft_consensus.cc:482] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:49:01.043433 11706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:49:01.046208 11706 raft_consensus.cc:504] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90125bbc58c43cb82773fd5c0d4dcc3" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38279 } }
I20260807 10:49:01.046928 11706 leader_election.cc:302] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c90125bbc58c43cb82773fd5c0d4dcc3; no voters:
I20260807 10:49:01.047660 11706 leader_election.cc:288] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:49:01.047842 11718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:49:01.049044 11718 raft_consensus.cc:686] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [term 1 LEADER]: Becoming Leader. State: Replica: c90125bbc58c43cb82773fd5c0d4dcc3, State: Running, Role: LEADER
I20260807 10:49:01.049763 11718 consensus_queue.cc:237] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90125bbc58c43cb82773fd5c0d4dcc3" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38279 } }
I20260807 10:49:01.050452 11706 sys_catalog.cc:564] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:49:01.053131 11719 sys_catalog.cc:455] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c90125bbc58c43cb82773fd5c0d4dcc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90125bbc58c43cb82773fd5c0d4dcc3" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38279 } } }
I20260807 10:49:01.053689 11719 sys_catalog.cc:458] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:01.056900 11723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:49:01.057135 11720 sys_catalog.cc:455] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c90125bbc58c43cb82773fd5c0d4dcc3. Latest consensus state: current_term: 1 leader_uuid: "c90125bbc58c43cb82773fd5c0d4dcc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c90125bbc58c43cb82773fd5c0d4dcc3" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 38279 } } }
I20260807 10:49:01.057582 11720 sys_catalog.cc:458] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:01.059749 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:01.040694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45677 (local address 127.11.46.190:38279)
0807 10:49:01.040978 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:01.040986 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:01.041524 (+ 538us) server_negotiation.cc:407] Connection header received
0807 10:49:01.041752 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:01.041756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:01.041831 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:01.041939 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:01.043789 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:01.044638 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:01.046106 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:01.046660 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:01.046817 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:01.050246 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:01.050254 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:01.050258 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:01.050307 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:01.054725 (+ 4418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:01.056000 (+ 1275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:01.056006 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:01.056011 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:01.056289 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:01.056952 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:01.056958 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:01.056962 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:01.057586 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:01.058695 (+ 1109us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:01.058907 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 10:49:01.059180 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 10:49:01.064190 11723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:49:01.085728 11723 catalog_manager.cc:1347] Generated new cluster ID: 41affd0fbed74b0db9735dfa6253d102
I20260807 10:49:01.085991 11723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:49:01.112344 11723 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:49:01.114957 11723 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:49:01.131652 11723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c90125bbc58c43cb82773fd5c0d4dcc3: Generated new TSK 0
I20260807 10:49:01.133136 11723 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:49:01.150262 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11591
I20260807 10:49:01.151665 11697 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:49:01.253082 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 11591
2026-08-07T10:49:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2475 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:49:01 dist-test-slave-42z9 krb5kdc[11750](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:49:01 dist-test-slave-42z9 krb5kdc[11750](info): set up 2 sockets
Aug 07 10:49:01 dist-test-slave-42z9 krb5kdc[11750](info): commencing operation
krb5kdc: starting...
W20260807 10:49:02.537170 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.075s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:49:02 dist-test-slave-42z9 krb5kdc[11750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:49:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:49:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:49:02.961285 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:42687
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:34869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:42687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:49:03.359750 11769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:49:03.360127 11769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:49:03.360275 11769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:49:03.368110 11769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:49:03.368276 11769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:49:03.368359 11769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:49:03.368448 11769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:49:03.368523 11769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:49:03.379459 11769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:34869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:42687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:42687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:49:03.381031 11769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:49:03.382700 11769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:49:03.395967 11781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:03.396064 11774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:03.396041 11776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:49:03.397192 11769 server_base.cc:1034] running on GCE node
I20260807 10:49:03.398175 11769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:49:03.399925 11769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:49:03.401167 11769 hybrid_clock.cc:648] HybridClock initialized: now 1786099743401120 us; error 42 us; skew 500 ppm
I20260807 10:49:03.401664 11769 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:49:03 dist-test-slave-42z9 krb5kdc[11750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099743, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:49:03.405512 11769 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:49:03.407644 11769 webserver.cc:460] Webserver started at http://127.11.46.190:34663/ using document root <none> and password file <none>
I20260807 10:49:03.408538 11769 fs_manager.cc:359] Metadata directory not provided
I20260807 10:49:03.408694 11769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:49:03.409044 11769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:49:03.412663 11769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "6b84913627754d8ebf5ad607d00bfff8"
format_stamp: "Formatted at 2026-08-07 10:49:03 on dist-test-slave-42z9"
server_key: "d3e0fd156c9884bcfe5aadddd97561b5"
server_key_iv: "28c98de7e1a261eba53e0fcfe8c634a8"
server_key_version: "encryptionkey@0"
I20260807 10:49:03.413625 11769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "6b84913627754d8ebf5ad607d00bfff8"
format_stamp: "Formatted at 2026-08-07 10:49:03 on dist-test-slave-42z9"
server_key: "d3e0fd156c9884bcfe5aadddd97561b5"
server_key_iv: "28c98de7e1a261eba53e0fcfe8c634a8"
server_key_version: "encryptionkey@0"
I20260807 10:49:03.420032 11769 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 10:49:03.424396 11791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:49:03.426517 11769 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260807 10:49:03.426766 11769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "6b84913627754d8ebf5ad607d00bfff8"
format_stamp: "Formatted at 2026-08-07 10:49:03 on dist-test-slave-42z9"
server_key: "d3e0fd156c9884bcfe5aadddd97561b5"
server_key_iv: "28c98de7e1a261eba53e0fcfe8c634a8"
server_key_version: "encryptionkey@0"
I20260807 10:49:03.427003 11769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:49:03.444579 11769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:49:03.449420 11769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:49:03.449779 11769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:49:03.469563 11769 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:42687
I20260807 10:49:03.469584 11859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:42687 every 8 connection(s)
I20260807 10:49:03.471269 11769 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:49:03.474098 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 11769
I20260807 10:49:03.474293 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:49:03.474797 11450 external_mini_cluster.cc:1428] Setting key f9cad73f46b2ae96d47087f7f35f4b9f
I20260807 10:49:03.476351 11861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:49:03.490742 11869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:03.477327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48271 (local address 127.11.46.190:42687)
0807 10:49:03.478310 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:03.478323 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:03.478381 (+ 58us) server_negotiation.cc:407] Connection header received
0807 10:49:03.480207 (+ 1826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:03.480240 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:03.480798 (+ 558us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:03.481226 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:03.482052 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:03.483569 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:03.485641 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:03.486433 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:03.486599 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:03.488023 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:03.488033 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:03.488055 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:49:03.488796 (+ 741us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:03.488893 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:49:03.488923 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:03.489043 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:03.489276 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 10:49:03.489621 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":411,"threads_started":1}
I20260807 10:49:03.491812 11861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8: Bootstrap starting.
I20260807 10:49:03.495226 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:49:03.496102 11861 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8: Neither blocks nor log segments found. Creating new log.
I20260807 10:49:03.497375 11861 log.cc:824] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8: Log is configured to *not* fsync() on all Append() calls
I20260807 10:49:03.501303 11861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8: No bootstrap required, opened a new log
I20260807 10:49:03.507678 11869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:03.500230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40779 (local address 127.11.46.190:42687)
0807 10:49:03.500464 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:03.500472 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:03.500923 (+ 451us) server_negotiation.cc:407] Connection header received
0807 10:49:03.501168 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:03.501172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:03.501241 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:03.501337 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:03.502085 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:03.502832 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:03.504873 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:03.505397 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:03.505587 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:03.506845 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:03.506851 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:03.506854 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:49:03.506881 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:03.506932 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:49:03.506953 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:03.507039 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:03.507206 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 10:49:03.507308 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 10:49:03.511619 11861 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b84913627754d8ebf5ad607d00bfff8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42687 } }
I20260807 10:49:03.512192 11861 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:49:03.512298 11861 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b84913627754d8ebf5ad607d00bfff8, State: Initialized, Role: FOLLOWER
I20260807 10:49:03.512933 11861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b84913627754d8ebf5ad607d00bfff8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42687 } }
I20260807 10:49:03.513226 11861 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:49:03.513391 11861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:49:03.513653 11861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:49:03.516299 11861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b84913627754d8ebf5ad607d00bfff8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42687 } }
I20260807 10:49:03.517045 11861 leader_election.cc:302] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b84913627754d8ebf5ad607d00bfff8; no voters:
I20260807 10:49:03.517954 11861 leader_election.cc:288] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:49:03.518258 11879 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:49:03.519706 11879 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [term 1 LEADER]: Becoming Leader. State: Replica: 6b84913627754d8ebf5ad607d00bfff8, State: Running, Role: LEADER
I20260807 10:49:03.520462 11879 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b84913627754d8ebf5ad607d00bfff8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42687 } }
I20260807 10:49:03.520699 11861 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:49:03.523916 11880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b84913627754d8ebf5ad607d00bfff8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b84913627754d8ebf5ad607d00bfff8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42687 } } }
I20260807 10:49:03.523890 11882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b84913627754d8ebf5ad607d00bfff8. Latest consensus state: current_term: 1 leader_uuid: "6b84913627754d8ebf5ad607d00bfff8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b84913627754d8ebf5ad607d00bfff8" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42687 } } }
I20260807 10:49:03.524461 11880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:03.524540 11882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:03.528086 11893 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:49:03.534158 11893 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:49:03.545496 11893 catalog_manager.cc:1347] Generated new cluster ID: db2b79f7168f4961ae5ca159ad8cfbda
I20260807 10:49:03.545661 11893 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:49:03.563818 11893 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:49:03.565271 11893 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:49:03.583971 11893 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b84913627754d8ebf5ad607d00bfff8: Generated new TSK 0
I20260807 10:49:03.585106 11893 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:49:03.606832 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11769
W20260807 10:49:03.608147 11854 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48271
W20260807 10:49:03.608943 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11769: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:49:03.609122 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 11769
2026-08-07T10:49:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2355 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:49:03 dist-test-slave-42z9 krb5kdc[11911](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:49:03 dist-test-slave-42z9 krb5kdc[11911](info): set up 2 sockets
Aug 07 10:49:03 dist-test-slave-42z9 krb5kdc[11911](info): commencing operation
krb5kdc: starting...
W20260807 10:49:04.894296 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.079s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:49:05 dist-test-slave-42z9 krb5kdc[11911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:49:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:49:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:49:05.330035 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35115
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:41685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:35115
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:49:05.732992 11935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:49:05.733340 11935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:49:05.733474 11935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:49:05.741195 11935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:49:05.741353 11935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:49:05.741417 11935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:49:05.741523 11935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:49:05.741576 11935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:49:05.752343 11935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:41685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:35115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:35115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:49:05.753959 11935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:49:05.755390 11935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:49:05.768571 11941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:05.768486 11945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:05.768543 11942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:49:05.769541 11935 server_base.cc:1034] running on GCE node
I20260807 10:49:05.770512 11935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:49:05.772241 11935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:49:05.773527 11935 hybrid_clock.cc:648] HybridClock initialized: now 1786099745773470 us; error 45 us; skew 500 ppm
I20260807 10:49:05.773942 11935 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:49:05 dist-test-slave-42z9 krb5kdc[11911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099745, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:49:05.777518 11935 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:49:05.779240 11935 webserver.cc:460] Webserver started at http://127.11.46.190:37505/ using document root <none> and password file <none>
I20260807 10:49:05.780048 11935 fs_manager.cc:359] Metadata directory not provided
I20260807 10:49:05.780177 11935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:49:05.780519 11935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:49:05.783931 11935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "dcdc8a66073649468a4d0f059bf9ea44"
format_stamp: "Formatted at 2026-08-07 10:49:05 on dist-test-slave-42z9"
server_key: "a552db7c9260408f93ef1f4202393083"
server_key_iv: "e617abde733f9197bc8b0cc3eb8dc9d1"
server_key_version: "encryptionkey@0"
I20260807 10:49:05.784811 11935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "dcdc8a66073649468a4d0f059bf9ea44"
format_stamp: "Formatted at 2026-08-07 10:49:05 on dist-test-slave-42z9"
server_key: "a552db7c9260408f93ef1f4202393083"
server_key_iv: "e617abde733f9197bc8b0cc3eb8dc9d1"
server_key_version: "encryptionkey@0"
I20260807 10:49:05.790548 11935 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260807 10:49:05.794469 11955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:49:05.795943 11935 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 10:49:05.796154 11935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "dcdc8a66073649468a4d0f059bf9ea44"
format_stamp: "Formatted at 2026-08-07 10:49:05 on dist-test-slave-42z9"
server_key: "a552db7c9260408f93ef1f4202393083"
server_key_iv: "e617abde733f9197bc8b0cc3eb8dc9d1"
server_key_version: "encryptionkey@0"
I20260807 10:49:05.796375 11935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:49:05.802580 11935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:49:05.807044 11935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:49:05.807353 11935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:49:05.827981 11935 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:35115
I20260807 10:49:05.828006 12024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:35115 every 8 connection(s)
I20260807 10:49:05.829670 11935 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:49:05.834089 12025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:49:05.834673 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 11935
I20260807 10:49:05.834923 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:49:05.835390 11450 external_mini_cluster.cc:1428] Setting key 8f78f156b84a6aa5b9c5356828131aa9
I20260807 10:49:05.844899 12030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:05.837351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53941 (local address 127.11.46.190:35115)
0807 10:49:05.838346 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:05.838360 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:05.838426 (+ 66us) server_negotiation.cc:407] Connection header received
0807 10:49:05.840893 (+ 2467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:05.840931 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:05.841476 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:05.841918 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:05.843129 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:05.843136 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:05.843152 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:49:05.843169 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:05.843239 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:49:05.843262 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:05.843473 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:05.843593 (+ 120us) server_negotiation.cc:299] Negotiation successful
0807 10:49:05.843828 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":733,"thread_start_us":426,"threads_started":1}
I20260807 10:49:05.849434 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:49:05.849478 12025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44: Bootstrap starting.
I20260807 10:49:05.853106 12025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44: Neither blocks nor log segments found. Creating new log.
I20260807 10:49:05.854532 12025 log.cc:824] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44: Log is configured to *not* fsync() on all Append() calls
I20260807 10:49:05.856814 12030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:05.854144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33089 (local address 127.11.46.190:35115)
0807 10:49:05.854371 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:05.854378 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:05.854839 (+ 461us) server_negotiation.cc:407] Connection header received
0807 10:49:05.855034 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:05.855039 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:05.855096 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:05.855206 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:05.856158 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:05.856165 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:05.856170 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 10:49:05.856188 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:05.856234 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 10:49:05.856249 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:05.856355 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:05.856466 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 10:49:05.856533 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:49:05.858161 12025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44: No bootstrap required, opened a new log
I20260807 10:49:05.866449 12025 raft_consensus.cc:348] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc8a66073649468a4d0f059bf9ea44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35115 } }
I20260807 10:49:05.866945 12025 raft_consensus.cc:374] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 10:49:05.867064 12025 raft_consensus.cc:729] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcdc8a66073649468a4d0f059bf9ea44, State: Initialized, Role: FOLLOWER
I20260807 10:49:05.867828 12025 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc8a66073649468a4d0f059bf9ea44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35115 } }
I20260807 10:49:05.868157 12025 raft_consensus.cc:388] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 10:49:05.868327 12025 raft_consensus.cc:482] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 10:49:05.868511 12025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:49:05.870972 12025 raft_consensus.cc:504] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc8a66073649468a4d0f059bf9ea44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35115 } }
I20260807 10:49:05.871526 12025 leader_election.cc:302] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dcdc8a66073649468a4d0f059bf9ea44; no voters:
I20260807 10:49:05.872181 12025 leader_election.cc:288] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 10:49:05.872349 12042 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:49:05.873039 12042 raft_consensus.cc:686] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [term 1 LEADER]: Becoming Leader. State: Replica: dcdc8a66073649468a4d0f059bf9ea44, State: Running, Role: LEADER
I20260807 10:49:05.873833 12042 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc8a66073649468a4d0f059bf9ea44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35115 } }
I20260807 10:49:05.874462 12025 sys_catalog.cc:564] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:49:05.876672 12043 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dcdc8a66073649468a4d0f059bf9ea44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc8a66073649468a4d0f059bf9ea44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35115 } } }
I20260807 10:49:05.876624 12046 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcdc8a66073649468a4d0f059bf9ea44. Latest consensus state: current_term: 1 leader_uuid: "dcdc8a66073649468a4d0f059bf9ea44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcdc8a66073649468a4d0f059bf9ea44" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 35115 } } }
I20260807 10:49:05.877135 12043 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:05.877133 12046 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:05.878372 12049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:49:05.883651 12049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:49:05.896414 12049 catalog_manager.cc:1347] Generated new cluster ID: 159c219d1bac4928bf7cec4a4262cee0
I20260807 10:49:05.896572 12049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:49:05.922276 12049 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:49:05.922847 12049 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:49:05.934677 12049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dcdc8a66073649468a4d0f059bf9ea44: Generated new TSK 0
I20260807 10:49:05.935776 12049 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 10:49:05.956154 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11935
W20260807 10:49:05.957947 12018 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53941
W20260807 10:49:05.958842 11450 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 11935: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 10:49:05.959028 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 11935
2026-08-07T10:49:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2355 ms)
[----------] 18 tests from AuthTokenIssuingTest (43284 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:49:06 dist-test-slave-42z9 krb5kdc[12072](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:49:06 dist-test-slave-42z9 krb5kdc[12072](info): set up 2 sockets
Aug 07 10:49:06 dist-test-slave-42z9 krb5kdc[12072](info): commencing operation
krb5kdc: starting...
W20260807 10:49:07.243196 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.001s sys 0.072s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:49:07 dist-test-slave-42z9 krb5kdc[12072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:49:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:49:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:49:07.663443 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:33937
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:40327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:33937,127.11.46.189:42353,127.11.46.188:43591
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:49:08.057338 12097 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:49:08.057827 12097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:49:08.057914 12097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:49:08.058004 12097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:49:08.065979 12097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:49:08.066100 12097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:49:08.066160 12097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:49:08.066215 12097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:49:08.066282 12097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:49:08.077112 12097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:40327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:33937,127.11.46.189:42353,127.11.46.188:43591
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:33937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:49:08.078765 12097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:49:08.080391 12097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:49:08.093814 12103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:08.093981 12102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:08.094528 12105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:49:08.095090 12097 server_base.cc:1034] running on GCE node
I20260807 10:49:08.096043 12097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:49:08.097820 12097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:49:08.099107 12097 hybrid_clock.cc:648] HybridClock initialized: now 1786099748099010 us; error 58 us; skew 500 ppm
I20260807 10:49:08.099539 12097 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:49:08 dist-test-slave-42z9 krb5kdc[12072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099748, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:49:08.106726 12097 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:49:08.108637 12097 webserver.cc:460] Webserver started at http://127.11.46.190:38925/ using document root <none> and password file <none>
I20260807 10:49:08.109539 12097 fs_manager.cc:359] Metadata directory not provided
I20260807 10:49:08.109669 12097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:49:08.110029 12097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:49:08.113637 12097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "1c3b7a721cad4975bff1b61b6fd0cb15"
format_stamp: "Formatted at 2026-08-07 10:49:08 on dist-test-slave-42z9"
server_key: "019a1bb652043259ae600da6dbe3a19d"
server_key_iv: "e927d45183d5e878b391d7901a66f0f5"
server_key_version: "encryptionkey@0"
I20260807 10:49:08.114665 12097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "1c3b7a721cad4975bff1b61b6fd0cb15"
format_stamp: "Formatted at 2026-08-07 10:49:08 on dist-test-slave-42z9"
server_key: "019a1bb652043259ae600da6dbe3a19d"
server_key_iv: "e927d45183d5e878b391d7901a66f0f5"
server_key_version: "encryptionkey@0"
I20260807 10:49:08.121032 12097 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260807 10:49:08.125804 12115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:49:08.127470 12097 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260807 10:49:08.127712 12097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "1c3b7a721cad4975bff1b61b6fd0cb15"
format_stamp: "Formatted at 2026-08-07 10:49:08 on dist-test-slave-42z9"
server_key: "019a1bb652043259ae600da6dbe3a19d"
server_key_iv: "e927d45183d5e878b391d7901a66f0f5"
server_key_version: "encryptionkey@0"
I20260807 10:49:08.127966 12097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:49:08.147791 12097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:49:08.152719 12097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:49:08.153034 12097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:49:08.173666 12097 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:33937
I20260807 10:49:08.173705 12196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:33937 every 8 connection(s)
I20260807 10:49:08.175173 12097 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:49:08.175735 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12097
I20260807 10:49:08.175943 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:49:08.176789 11450 external_mini_cluster.cc:1428] Setting key 2bb0319c782e1873844a278cf1c98bb7
I20260807 10:49:08.179692 12198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:49:08.187279 12198 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:49:08 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099748, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:49:08.215198 12202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.192943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55750 (local address 127.11.46.190:33937)
0807 10:49:08.193801 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:08.193810 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:08.193874 (+ 64us) server_negotiation.cc:407] Connection header received
0807 10:49:08.195208 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:08.195214 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:08.195517 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:08.195716 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:08.197189 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.198545 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.200057 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.200670 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.200878 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:08.205041 (+ 4163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:08.205055 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:08.205077 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:08.205125 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:08.208844 (+ 3719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:08.209944 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:08.209961 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:08.209965 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:08.210535 (+ 570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:08.211187 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:08.211193 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:08.211196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:08.212299 (+ 1103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:08.212545 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:08.213255 (+ 710us) server_negotiation.cc:299] Negotiation successful
0807 10:49:08.213706 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":218,"server-negotiator.queue_time_us":621,"thread_start_us":381,"threads_started":1}
I20260807 10:49:08.215220 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.191361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:33937 (local address 127.0.0.1:55750)
0807 10:49:08.192304 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.192360 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:08.194731 (+ 2371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:08.195767 (+ 1036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:08.195774 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:08.196571 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:08.196961 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:08.196982 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.198712 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.198716 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:08.199898 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:08.199914 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.200937 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.200944 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:08.201217 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:08.201992 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:08.202020 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:08.204692 (+ 2672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:08.209056 (+ 4364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:08.209069 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:08.209081 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:08.209610 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:08.210781 (+ 1171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:08.210784 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:08.210788 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:08.211020 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:08.212504 (+ 1484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:08.212511 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:08.212752 (+ 241us) client_negotiation.cc:769] Sending connection context
0807 10:49:08.212997 (+ 245us) client_negotiation.cc:240] Negotiation successful
0807 10:49:08.213566 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"mutex_wait_us":1,"thread_start_us":379,"threads_started":1}
WARNING: no policy specified for kudu/127.11.46.189@KRBTEST.COM; defaulting to no policy
I20260807 10:49:08.218472 12198 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:49:08.219779 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.219262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35084)
0807 10:49:08.219511 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.219633 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260807 10:49:08.220106 12117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.189@KRBTEST.COM" created.
I20260807 10:49:08.221920 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.221400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35086)
0807 10:49:08.221656 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.221758 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260807 10:49:08.222146 12198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:42353: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab.
Entry for principal kudu/127.11.46.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab.
I20260807 10:49:08.264849 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.189:42353
--webserver_interface=127.11.46.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab
--principal=kudu/127.11.46.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:40327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:33937,127.11.46.189:42353,127.11.46.188:43591
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:49:08.271524 12198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } attempt: 1
I20260807 10:49:08.272873 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.272363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35090)
0807 10:49:08.272584 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.272720 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 10:49:08.273977 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.273602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35104)
0807 10:49:08.273754 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.273828 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 10:49:08.274170 12198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:42353: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
I20260807 10:49:08.342478 12198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } attempt: 2
I20260807 10:49:08.343830 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.343299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35106)
0807 10:49:08.343575 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.343679 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260807 10:49:08.344918 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.344515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35118)
0807 10:49:08.344674 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.344768 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 10:49:08.345131 12198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:42353: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
I20260807 10:49:08.436434 12198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } attempt: 3
I20260807 10:49:08.437697 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.437219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35124)
0807 10:49:08.437462 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.437556 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 10:49:08.438720 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.438347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35132)
0807 10:49:08.438506 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.438579 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 10:49:08.438915 12198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:42353: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
I20260807 10:49:08.582216 12198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } attempt: 4
I20260807 10:49:08.583492 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.582908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35146)
0807 10:49:08.583225 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.583316 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
I20260807 10:49:08.584543 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.584157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35158)
0807 10:49:08.584309 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.584400 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260807 10:49:08.584748 12198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:42353: Network error: Client connection negotiation failed: client connection to 127.11.46.189:42353: connect: Connection refused (error 111)
W20260807 10:49:08.665921 12208 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:49:08.666349 12208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:49:08.666472 12208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:49:08.666594 12208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:49:08.674525 12208 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:49:08.674667 12208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:49:08.674762 12208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:49:08.674839 12208 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:49:08.674932 12208 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:49:08.685985 12208 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:40327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:33937,127.11.46.189:42353,127.11.46.188:43591
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab
--principal=kudu/127.11.46.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.189:42353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.46.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:49:08.687551 12208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:49:08.689064 12208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:49:08.702478 12213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:08.702558 12218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:08.702517 12214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:49:08.703490 12208 server_base.cc:1034] running on GCE node
I20260807 10:49:08.704432 12208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:49:08.706246 12208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:49:08.707507 12208 hybrid_clock.cc:648] HybridClock initialized: now 1786099748707403 us; error 60 us; skew 500 ppm
I20260807 10:49:08.707894 12208 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:49:08 dist-test-slave-42z9 krb5kdc[12072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099748, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:49:08.711596 12208 init.cc:377] Logged in from keytab as kudu/127.11.46.189@KRBTEST.COM (short username kudu)
I20260807 10:49:08.713616 12208 webserver.cc:460] Webserver started at http://127.11.46.189:41941/ using document root <none> and password file <none>
I20260807 10:49:08.714543 12208 fs_manager.cc:359] Metadata directory not provided
I20260807 10:49:08.714660 12208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:49:08.715029 12208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:49:08.718760 12208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/data/instance:
uuid: "730a92b6c53a49bdaf430cabc9a42df7"
format_stamp: "Formatted at 2026-08-07 10:49:08 on dist-test-slave-42z9"
server_key: "2a26f1657bc362418c85ba1e2716f5c1"
server_key_iv: "c54797048dfb5fc41ce6332942c03575"
server_key_version: "encryptionkey@0"
I20260807 10:49:08.719720 12208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/wal/instance:
uuid: "730a92b6c53a49bdaf430cabc9a42df7"
format_stamp: "Formatted at 2026-08-07 10:49:08 on dist-test-slave-42z9"
server_key: "2a26f1657bc362418c85ba1e2716f5c1"
server_key_iv: "c54797048dfb5fc41ce6332942c03575"
server_key_version: "encryptionkey@0"
I20260807 10:49:08.726209 12208 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 10:49:08.730592 12230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:49:08.732352 12208 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 10:49:08.732570 12208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/wal
uuid: "730a92b6c53a49bdaf430cabc9a42df7"
format_stamp: "Formatted at 2026-08-07 10:49:08 on dist-test-slave-42z9"
server_key: "2a26f1657bc362418c85ba1e2716f5c1"
server_key_iv: "c54797048dfb5fc41ce6332942c03575"
server_key_version: "encryptionkey@0"
I20260807 10:49:08.732815 12208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:49:08.751427 12208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:49:08.756316 12208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:49:08.756667 12208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:49:08.777665 12208 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.189:42353
I20260807 10:49:08.777663 12309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.189:42353 every 8 connection(s)
I20260807 10:49:08.779265 12208 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
I20260807 10:49:08.783602 12310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:49:08.787613 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12208
I20260807 10:49:08.787791 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-1/wal/instance
I20260807 10:49:08.788259 11450 external_mini_cluster.cc:1428] Setting key 000cdb4f51e9486ba6af90340d3cdfeb
I20260807 10:49:08.791572 12310 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:49:08 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099748, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:49:08.817549 12314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.794726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55752 (local address 127.11.46.190:33937)
0807 10:49:08.795340 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:08.795347 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:08.796571 (+ 1224us) server_negotiation.cc:407] Connection header received
0807 10:49:08.799427 (+ 2856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:08.799432 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:08.799538 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:08.799649 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:08.802113 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.803074 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.805484 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.805927 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.806046 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:08.810367 (+ 4321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:08.810375 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:08.810380 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:08.810455 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:08.813809 (+ 3354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:08.814812 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:08.814818 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:08.814821 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:08.814979 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:08.815429 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:08.815434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:08.815437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:08.815865 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:08.816027 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:08.816809 (+ 782us) server_negotiation.cc:299] Negotiation successful
0807 10:49:08.817097 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":329,"threads_started":1}
I20260807 10:49:08.818429 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.795350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:33937 (local address 127.0.0.1:55752)
0807 10:49:08.796322 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.796402 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:08.798990 (+ 2588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:08.799991 (+ 1001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:08.800005 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:08.800869 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:08.801840 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:08.801872 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.803293 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.803299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:08.805264 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:08.805293 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.806209 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.806216 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:08.806553 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:08.807407 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:08.807441 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:08.810045 (+ 2604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:08.814008 (+ 3963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:08.814018 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:08.814038 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:08.814646 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:08.815086 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:08.815089 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:08.815091 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:08.815293 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:08.815983 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:08.815990 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:08.816400 (+ 410us) client_negotiation.cc:769] Sending connection context
0807 10:49:08.816664 (+ 264us) client_negotiation.cc:240] Negotiation successful
0807 10:49:08.817132 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":356,"threads_started":1}
I20260807 10:49:08.820521 12310 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:49:08 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099748, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.46.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.188@KRBTEST.COM" created.
I20260807 10:49:08.838413 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.821530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35162)
0807 10:49:08.821737 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.821760 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:08.821887 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:08.823250 (+ 1363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:08.823254 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:08.823682 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:08.823851 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:08.823861 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.825846 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.825851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:08.826755 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:08.826770 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.828087 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.828092 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:08.828268 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:08.828894 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:08.828913 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:08.831426 (+ 2513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:08.835445 (+ 4019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:08.835450 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:08.835454 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:08.835867 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:08.836377 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:08.836381 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:08.836384 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:08.836574 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:08.837491 (+ 917us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:08.837497 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:08.837643 (+ 146us) client_negotiation.cc:769] Sending connection context
0807 10:49:08.837805 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 10:49:08.838090 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":1}
I20260807 10:49:08.838783 12319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.821835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35162 (local address 127.11.46.189:42353)
0807 10:49:08.822651 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:08.822659 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:08.822696 (+ 37us) server_negotiation.cc:407] Connection header received
0807 10:49:08.822758 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:08.822768 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:08.823061 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:08.823229 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:08.824069 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.825662 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.826931 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.827912 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.828072 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:08.831756 (+ 3684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:08.831775 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:08.831800 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:08.831850 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:08.835259 (+ 3409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:08.836044 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:08.836054 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:08.836057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:08.836223 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:08.836708 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:08.836713 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:08.836716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:08.837290 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:08.837582 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:08.837982 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 10:49:08.838265 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":601,"spinlock_wait_cycles":35200,"thread_start_us":438,"threads_started":1}
I20260807 10:49:08.841377 12310 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:49:08.842788 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.842274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:44982)
0807 10:49:08.842469 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.842603 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260807 10:49:08.843169 12233 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
I20260807 10:49:08.844949 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.844558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:44998)
0807 10:49:08.844722 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.844816 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 10:49:08.845237 12310 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:43591: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab.
Entry for principal kudu/127.11.46.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab.
I20260807 10:49:08.880717 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.188:43591
--webserver_interface=127.11.46.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab
--principal=kudu/127.11.46.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:40327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:33937,127.11.46.189:42353,127.11.46.188:43591
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:49:08.884055 12198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } attempt: 5
Aug 07 10:49:08 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099748, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
I20260807 10:49:08.894662 12310 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } attempt: 1
I20260807 10:49:08.896096 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.895412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45000)
0807 10:49:08.895746 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.895889 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
I20260807 10:49:08.897478 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.896984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45012)
0807 10:49:08.897179 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.897282 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 10:49:08.897775 12310 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:43591: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
I20260807 10:49:08.898984 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.884924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35166)
0807 10:49:08.885132 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.885157 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:08.885297 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:08.885708 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:08.885713 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:08.886166 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:08.886381 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:08.886392 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.887443 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.887447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:08.888355 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:08.888370 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.889304 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.889310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:08.889563 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:08.890222 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:08.890241 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:08.892549 (+ 2308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:08.896120 (+ 3571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:08.896126 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:08.896131 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:08.896717 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:08.897186 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:08.897191 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:08.897195 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:08.897397 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:08.898125 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:08.898129 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:08.898288 (+ 159us) client_negotiation.cc:769] Sending connection context
0807 10:49:08.898429 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 10:49:08.898715 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 10:49:08.899106 12319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.885050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35166 (local address 127.11.46.189:42353)
0807 10:49:08.885294 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:08.885300 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:08.885324 (+ 24us) server_negotiation.cc:407] Connection header received
0807 10:49:08.885485 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:08.885491 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:08.885563 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:08.885651 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:08.886562 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.887289 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.888522 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:08.889141 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:08.889267 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:08.892822 (+ 3555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:08.892827 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:08.892831 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:08.892884 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:08.895911 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:08.896849 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:08.896855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:08.896857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:08.897038 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:08.897538 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:08.897543 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:08.897546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:08.897980 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:08.898150 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:08.898561 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 10:49:08.898812 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 10:49:08.900156 12198 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:49:08.901582 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.901058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45026)
0807 10:49:08.901253 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.901366 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 10:49:08.902793 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.902403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45032)
0807 10:49:08.902565 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.902670 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:49:08.903025 12198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:43591: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
I20260807 10:49:08.954274 12198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } attempt: 1
I20260807 10:49:08.955893 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.955235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45042)
0807 10:49:08.955489 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.955620 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 10:49:08.957172 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.956705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45050)
0807 10:49:08.956894 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.957005 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 10:49:08.957432 12198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:43591: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
I20260807 10:49:08.966023 12310 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } attempt: 2
I20260807 10:49:08.967454 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.966863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45060)
0807 10:49:08.967104 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.967228 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 10:49:08.968696 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:08.968252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45064)
0807 10:49:08.968420 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:08.968522 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:49:08.968976 12310 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:43591: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
I20260807 10:49:09.025713 12198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } attempt: 2
I20260807 10:49:09.027225 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.026526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45066)
0807 10:49:09.026828 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.026973 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260807 10:49:09.028901 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.028343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45074)
0807 10:49:09.028602 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.028724 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260807 10:49:09.029227 12198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:43591: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
I20260807 10:49:09.060231 12310 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } attempt: 3
I20260807 10:49:09.061687 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.060979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45090)
0807 10:49:09.061254 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.061403 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260807 10:49:09.063213 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.062610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45092)
0807 10:49:09.062902 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.063034 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165}
W20260807 10:49:09.063511 12310 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:43591: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
I20260807 10:49:09.135514 12198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } attempt: 3
I20260807 10:49:09.137007 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.136338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45102)
0807 10:49:09.136600 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.136729 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260807 10:49:09.138365 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.137848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45112)
0807 10:49:09.138135 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.138227 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
W20260807 10:49:09.138638 12198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:43591: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
I20260807 10:49:09.206779 12310 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } attempt: 4
I20260807 10:49:09.208377 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.207673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45122)
0807 10:49:09.208002 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.208128 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260807 10:49:09.209699 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.209213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45126)
0807 10:49:09.209400 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.209539 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 10:49:09.209964 12310 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:43591: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
W20260807 10:49:09.300293 12323 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:49:09.300717 12323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:49:09.300832 12323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:49:09.300958 12323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:49:09.308907 12323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:49:09.309034 12323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:49:09.309103 12323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:49:09.309182 12323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:49:09.309275 12323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:49:09.315961 12198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } attempt: 4
I20260807 10:49:09.317659 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.316997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45136)
0807 10:49:09.317292 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.317399 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260807 10:49:09.318854 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.318495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45146)
0807 10:49:09.318641 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.318721 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:49:09.319070 12198 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:43591: Network error: Client connection negotiation failed: client connection to 127.11.46.188:43591: connect: Connection refused (error 111)
I20260807 10:49:09.321166 12323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:40327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:33937,127.11.46.189:42353,127.11.46.188:43591
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab
--principal=kudu/127.11.46.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.188:43591
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.46.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:49:09.322875 12323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:49:09.324486 12323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:49:09.337926 12332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:09.337838 12336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:09.337888 12333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:49:09.339401 12323 server_base.cc:1034] running on GCE node
I20260807 10:49:09.340305 12323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:49:09.341985 12323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:49:09.343221 12323 hybrid_clock.cc:648] HybridClock initialized: now 1786099749343151 us; error 44 us; skew 500 ppm
I20260807 10:49:09.343591 12323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:49:09 dist-test-slave-42z9 krb5kdc[12072](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099749, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:49:09.346961 12323 init.cc:377] Logged in from keytab as kudu/127.11.46.188@KRBTEST.COM (short username kudu)
I20260807 10:49:09.348619 12323 webserver.cc:460] Webserver started at http://127.11.46.188:34971/ using document root <none> and password file <none>
I20260807 10:49:09.349361 12323 fs_manager.cc:359] Metadata directory not provided
I20260807 10:49:09.349512 12323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:49:09.349840 12323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:49:09.353191 12323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/data/instance:
uuid: "1ea8179e27dd4745a4914cd28d2ae9c2"
format_stamp: "Formatted at 2026-08-07 10:49:09 on dist-test-slave-42z9"
server_key: "358dcc38a430886852383582c5b08b11"
server_key_iv: "af127fc0c519e405cc9a5b353ce643b7"
server_key_version: "encryptionkey@0"
I20260807 10:49:09.354111 12323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/wal/instance:
uuid: "1ea8179e27dd4745a4914cd28d2ae9c2"
format_stamp: "Formatted at 2026-08-07 10:49:09 on dist-test-slave-42z9"
server_key: "358dcc38a430886852383582c5b08b11"
server_key_iv: "af127fc0c519e405cc9a5b353ce643b7"
server_key_version: "encryptionkey@0"
I20260807 10:49:09.360116 12323 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260807 10:49:09.364530 12349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:49:09.366503 12323 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 10:49:09.366730 12323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/wal
uuid: "1ea8179e27dd4745a4914cd28d2ae9c2"
format_stamp: "Formatted at 2026-08-07 10:49:09 on dist-test-slave-42z9"
server_key: "358dcc38a430886852383582c5b08b11"
server_key_iv: "af127fc0c519e405cc9a5b353ce643b7"
server_key_version: "encryptionkey@0"
I20260807 10:49:09.367004 12323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:49:09.410218 12323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:49:09.415040 12323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:49:09.415361 12323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:49:09.437602 12323 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.188:43591
I20260807 10:49:09.437613 12420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.188:43591 every 8 connection(s)
I20260807 10:49:09.439249 12323 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
I20260807 10:49:09.443733 12421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:49:09.446745 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12323
I20260807 10:49:09.447000 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786099355061134-11450-0/minicluster-data/master-2/wal/instance
I20260807 10:49:09.447451 11450 external_mini_cluster.cc:1428] Setting key 1fa7e6128e1aa24278121fa8ef9aa13b
I20260807 10:49:09.452219 12421 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:49:09 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
Aug 07 10:49:09 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099749, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:49:09.471050 12429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.455090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55768 (local address 127.11.46.190:33937)
0807 10:49:09.456382 (+ 1292us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.456387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.456402 (+ 15us) server_negotiation.cc:407] Connection header received
0807 10:49:09.456473 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.456477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.456545 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.456645 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.457983 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.458692 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.460148 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.460596 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.460714 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.464881 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.464887 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.464891 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.464939 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.467602 (+ 2663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.468440 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.468444 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.468446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.468594 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.469026 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.469030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.469032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.469314 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.469511 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.470144 (+ 633us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.470408 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1186,"thread_start_us":1090,"threads_started":1}
I20260807 10:49:09.472065 12426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.449607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45154 (local address 127.11.46.188:43591)
0807 10:49:09.450535 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.450548 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.450595 (+ 47us) server_negotiation.cc:407] Connection header received
0807 10:49:09.452395 (+ 1800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.452422 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.452886 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.453288 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.455069 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.456951 (+ 1882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.458338 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.459077 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.459264 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.464035 (+ 4771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.464046 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.464063 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.464108 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.467314 (+ 3206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.468174 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.468186 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.468188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.468383 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.468810 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.468814 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.468816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.469466 (+ 650us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.469811 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.470187 (+ 376us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.470640 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":674,"thread_start_us":433,"threads_started":1}
I20260807 10:49:09.472105 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.454996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:33937 (local address 127.0.0.1:55768)
0807 10:49:09.455796 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.455842 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:09.456012 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:09.456778 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:09.456785 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:09.457522 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:09.457820 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:09.457830 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.458859 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.458863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:09.459980 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:09.459994 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.460866 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.460875 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:09.461032 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.461766 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:09.461794 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:09.464629 (+ 2835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:09.467770 (+ 3141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:09.467785 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:09.467796 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:09.468305 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:09.468713 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:09.468718 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:09.468722 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:09.468907 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:09.469516 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:09.469525 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:09.469756 (+ 231us) client_negotiation.cc:769] Sending connection context
0807 10:49:09.470020 (+ 264us) client_negotiation.cc:240] Negotiation successful
0807 10:49:09.470815 (+ 795us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"mutex_wait_us":207,"spinlock_wait_cycles":19840,"thread_start_us":354,"threads_started":1}
I20260807 10:49:09.475028 12421 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:49:09 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099749, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
Aug 07 10:49:09 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:49:09.494064 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.476015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:42353 (local address 127.0.0.1:35178)
0807 10:49:09.476286 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.476305 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:09.476409 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:09.479876 (+ 3467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:09.479881 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:09.480308 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:09.480493 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:09.480504 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.481829 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.481836 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:09.482868 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:09.482885 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.483732 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.483739 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:09.483960 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.484567 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:09.484586 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:09.487089 (+ 2503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:09.490691 (+ 3602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:09.490698 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:09.490701 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:09.491274 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:09.491936 (+ 662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:09.491943 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:09.491946 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:09.492194 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:09.492929 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:09.492935 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:09.493173 (+ 238us) client_negotiation.cc:769] Sending connection context
0807 10:49:09.493321 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 10:49:09.493761 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260807 10:49:09.494187 12431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.476025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35178 (local address 127.11.46.189:42353)
0807 10:49:09.479480 (+ 3455us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.479485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.479505 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:49:09.479565 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.479570 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.479646 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.479784 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.480735 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.481658 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.483048 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.483554 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.483668 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.487364 (+ 3696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.487372 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.487377 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.487428 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.490406 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.491467 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.491482 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.491486 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.491680 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.492405 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.492409 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.492411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.492747 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.492883 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.493538 (+ 655us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.493747 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3326,"thread_start_us":3174,"threads_started":1}
I20260807 10:49:09.495386 12421 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:49:09.495642 12429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.476120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55782 (local address 127.11.46.190:33937)
0807 10:49:09.476333 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.476340 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.478953 (+ 2613us) server_negotiation.cc:407] Connection header received
0807 10:49:09.479226 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.479231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.479318 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.479425 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.481027 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.481901 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.483271 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.483740 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.483867 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.488523 (+ 4656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.488530 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.488533 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.488589 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.492171 (+ 3582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.493099 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.493103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.493106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.493254 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.493800 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.493805 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.493808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.494204 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.494538 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.495082 (+ 544us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.495327 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 10:49:09 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099749, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
Aug 07 10:49:09 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
I20260807 10:49:09.509266 12310 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } attempt: 5
I20260807 10:49:09.512347 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.496424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45160)
0807 10:49:09.496615 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.496632 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:09.496743 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:09.497222 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:09.497226 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:09.497771 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:09.497945 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:09.497956 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.498968 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.498974 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:09.499875 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:09.499887 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.500591 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.500597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:09.500828 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.501498 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:09.501517 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:09.503858 (+ 2341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:09.508554 (+ 4696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:09.508562 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:09.508567 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:09.509303 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:09.509850 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:09.509855 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:09.509859 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:09.510054 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:09.511112 (+ 1058us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:09.511117 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:09.511340 (+ 223us) client_negotiation.cc:769] Sending connection context
0807 10:49:09.511516 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 10:49:09.511942 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 10:49:09.513618 12426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.496782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45160 (local address 127.11.46.188:43591)
0807 10:49:09.496953 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.496959 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.496978 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:49:09.497020 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.497024 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.497083 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.497193 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.498092 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.498838 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.500018 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.500438 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.500566 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.504121 (+ 3555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.504129 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.504134 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.504179 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.508321 (+ 4142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.509483 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.509489 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.509493 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.509703 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.510252 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.510259 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.510263 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.510836 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.511022 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.511692 (+ 670us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.513223 (+ 1531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1169,"server-negotiator.queue_time_us":59}
I20260807 10:49:09.516940 12431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.497595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35190 (local address 127.11.46.189:42353)
0807 10:49:09.497791 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.497797 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.498107 (+ 310us) server_negotiation.cc:407] Connection header received
0807 10:49:09.498249 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.498255 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.498323 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.498402 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.499723 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.500445 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.501842 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.502294 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.502412 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.508448 (+ 6036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.508461 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.508468 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.508546 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.513296 (+ 4750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.514421 (+ 1125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.514428 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.514431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.514609 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.515155 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.515164 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.515168 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.515587 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.515909 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.516279 (+ 370us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.516577 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 10:49:09 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099748, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
I20260807 10:49:09.520983 12421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2: Bootstrap starting.
I20260807 10:49:09.523133 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:49:09.526356 12421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2: Neither blocks nor log segments found. Creating new log.
I20260807 10:49:09.528079 12421 log.cc:824] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2: Log is configured to *not* fsync() on all Append() calls
I20260807 10:49:09.526202 12151 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55782
I20260807 10:49:09.529515 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.510320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45162)
0807 10:49:09.510716 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.510737 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:09.510870 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:09.511976 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:09.511988 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:09.512832 (+ 844us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:09.513124 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:09.513146 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.514768 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.514773 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:09.516085 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:09.516104 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.517167 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.517175 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:09.517539 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.518357 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:09.518377 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:09.521322 (+ 2945us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:09.526224 (+ 4902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:09.526231 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:09.526236 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:09.526893 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:09.527477 (+ 584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:09.527483 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:09.527486 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:09.527690 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:09.528481 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:09.528487 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:09.528671 (+ 184us) client_negotiation.cc:769] Sending connection context
0807 10:49:09.528829 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 10:49:09.529172 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242}
I20260807 10:49:09.530687 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.510537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45162 (local address 127.11.46.188:43591)
0807 10:49:09.511558 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.511564 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.511586 (+ 22us) server_negotiation.cc:407] Connection header received
0807 10:49:09.511638 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.511643 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.511716 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.511896 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.513348 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.514643 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.516280 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.516966 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.517600 (+ 634us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.521673 (+ 4073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.521681 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.521686 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.521734 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.525827 (+ 4093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.527114 (+ 1287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.527120 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.527123 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.527317 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.527869 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.527874 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.527877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.528323 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.529843 (+ 1520us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.529993 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.530257 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":843,"thread_start_us":609,"threads_started":1}
I20260807 10:49:09.533356 12421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2: No bootstrap required, opened a new log
I20260807 10:49:09.537187 12310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7: Bootstrap starting.
I20260807 10:49:09.541234 12310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7: Neither blocks nor log segments found. Creating new log.
I20260807 10:49:09.542888 12310 log.cc:824] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7: Log is configured to *not* fsync() on all Append() calls
I20260807 10:49:09.543606 12421 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } }
I20260807 10:49:09.544088 12421 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ea8179e27dd4745a4914cd28d2ae9c2, State: Initialized, Role: FOLLOWER
I20260807 10:49:09.544628 12421 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } }
I20260807 10:49:09.545748 12436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } } }
I20260807 10:49:09.546277 12436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:09.546929 12310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7: No bootstrap required, opened a new log
I20260807 10:49:09.547231 12421 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:49:09.556824 12310 raft_consensus.cc:348] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } }
I20260807 10:49:09.557296 12310 raft_consensus.cc:729] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 730a92b6c53a49bdaf430cabc9a42df7, State: Initialized, Role: FOLLOWER
I20260807 10:49:09.557938 12310 consensus_queue.cc:260] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } }
W20260807 10:49:09.559607 12456 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:49:09.559758 12456 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:49:09.559430 12461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } } }
I20260807 10:49:09.560461 12461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:09.560539 12310 sys_catalog.cc:564] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:49:09.556711 12323 master_runner.cc:186] Error getting master registration for 127.11.46.190:33937: OK, instance_id { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" instance_seqno: 1786099748168111 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:49:09.568571 12323 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 10:49:09.588969 12476 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:49:09.589149 12476 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:49:09.596246 12198 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } attempt: 5
Aug 07 10:49:09 dist-test-slave-42z9 krb5kdc[12072](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099748, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
I20260807 10:49:09.587827 12208 master_runner.cc:186] Error getting master registration for 127.11.46.190:33937: OK, instance_id { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" instance_seqno: 1786099748168111 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:49:09.611495 12208 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 10:49:09.620271 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.597687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45164 (local address 127.11.46.188:43591)
0807 10:49:09.597895 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.597902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.597920 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:49:09.597987 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.597993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.598123 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.598236 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.599244 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.600394 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.602229 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.602835 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.602972 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.608404 (+ 5432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.608414 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.608419 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.608480 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.612898 (+ 4418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.615019 (+ 2121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.615026 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.615070 (+ 44us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.615506 (+ 436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.616725 (+ 1219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.616736 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.616739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.617613 (+ 874us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.617914 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.618977 (+ 1063us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.619583 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 10:49:09.622205 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.597179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:43591 (local address 127.0.0.1:45164)
0807 10:49:09.597428 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:09.597478 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:09.597629 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:09.598284 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:09.598289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:09.598847 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:09.599074 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:09.599087 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.600560 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.600566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:09.602001 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:09.602020 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.603268 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.603275 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:09.603491 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.604302 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:09.604328 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:09.607948 (+ 3620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:09.613296 (+ 5348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:09.613304 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:09.613309 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:09.614609 (+ 1300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:09.615907 (+ 1298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:09.615946 (+ 39us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:09.615950 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:09.616431 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:09.618100 (+ 1669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:09.618106 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:09.618426 (+ 320us) client_negotiation.cc:769] Sending connection context
0807 10:49:09.620833 (+ 2407us) client_negotiation.cc:240] Negotiation successful
0807 10:49:09.621429 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260807 10:49:09.629663 12198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15: Bootstrap starting.
I20260807 10:49:09.637544 12198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15: Neither blocks nor log segments found. Creating new log.
I20260807 10:49:09.640280 12198 log.cc:824] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15: Log is configured to *not* fsync() on all Append() calls
I20260807 10:49:09.646602 12198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15: No bootstrap required, opened a new log
I20260807 10:49:09.662026 12198 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } }
I20260807 10:49:09.662909 12198 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c3b7a721cad4975bff1b61b6fd0cb15, State: Initialized, Role: FOLLOWER
I20260807 10:49:09.663928 12198 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } }
I20260807 10:49:09.665620 12485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } } }
I20260807 10:49:09.666131 12485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 10:49:09.667977 12359 tablet.cc:2369] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:49:09.669750 12151 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 10:49:09.669984 12151 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:49:09.673661 12151 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } }
I20260807 10:49:09.676570 12272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "730a92b6c53a49bdaf430cabc9a42df7"
I20260807 10:49:09.676755 12388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2"
I20260807 10:49:09.677292 12388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:49:09.677315 12272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:49:09.681208 12388 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c3b7a721cad4975bff1b61b6fd0cb15 in term 1.
I20260807 10:49:09.681267 12272 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c3b7a721cad4975bff1b61b6fd0cb15 in term 1.
I20260807 10:49:09.682227 12118 leader_election.cc:302] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c3b7a721cad4975bff1b61b6fd0cb15, 1ea8179e27dd4745a4914cd28d2ae9c2; no voters:
I20260807 10:49:09.682904 12485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:49:09.683240 12151 leader_election.cc:288] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [CANDIDATE]: Term 1 election: Requested vote from peers 730a92b6c53a49bdaf430cabc9a42df7 (127.11.46.189:42353), 1ea8179e27dd4745a4914cd28d2ae9c2 (127.11.46.188:43591)
I20260807 10:49:09.690762 12198 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:49:09.701359 12485 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [term 1 LEADER]: Becoming Leader. State: Replica: 1c3b7a721cad4975bff1b61b6fd0cb15, State: Running, Role: LEADER
I20260807 10:49:09.702279 12485 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } }
I20260807 10:49:09.711789 12486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c3b7a721cad4975bff1b61b6fd0cb15. Latest consensus state: current_term: 1 leader_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } } }
I20260807 10:49:09.712297 12486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:09.718335 12502 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:49:09.726162 12502 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260807 10:49:09.760030 12238 tablet.cc:2369] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:49:09.776834 12388 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [term 1 FOLLOWER]: Refusing update from remote peer 1c3b7a721cad4975bff1b61b6fd0cb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:49:09.778326 12486 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:49:09.787813 12272 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [term 1 FOLLOWER]: Refusing update from remote peer 1c3b7a721cad4975bff1b61b6fd0cb15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:49:09.789027 12486 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:49:09.808962 12461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c3b7a721cad4975bff1b61b6fd0cb15. Latest consensus state: current_term: 1 leader_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } } }
I20260807 10:49:09.809369 12461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:09.812175 12512 mvcc.cc:205] Tried to move back new op lower bound from 7315864575038095360 to 7315864574787260416. Current Snapshot: MvccSnapshot[applied={T|T < 7315864575038095360}]
I20260807 10:49:09.834275 12486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } } }
I20260807 10:49:09.834614 12486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:09.835866 12436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c3b7a721cad4975bff1b61b6fd0cb15. Latest consensus state: current_term: 1 leader_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } } }
I20260807 10:49:09.836241 12436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:09.837776 12502 catalog_manager.cc:1347] Generated new cluster ID: 3a5a8fecd60c4e59b36d897cd0d0637f
I20260807 10:49:09.837910 12502 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:49:09.877859 12429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.737600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45748 (local address 127.11.46.190:33937)
0807 10:49:09.737785 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.737790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.764228 (+ 26438us) server_negotiation.cc:407] Connection header received
0807 10:49:09.764535 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.764542 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.764643 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.764728 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.767577 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.768825 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.822451 (+ 53626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.823316 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.823444 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.869636 (+ 46192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.869644 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.869650 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.869704 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.873948 (+ 4244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.875040 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.875047 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.875051 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.875221 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.875700 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.875706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.875709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.876137 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.876462 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.877124 (+ 662us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.877424 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 10:49:09.881177 12485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } } }
I20260807 10:49:09.883471 12485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:09.884106 12436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } } }
I20260807 10:49:09.884410 12436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:09.898029 12431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.736778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44986 (local address 127.11.46.189:42353)
0807 10:49:09.737033 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.737049 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.760570 (+ 23521us) server_negotiation.cc:407] Connection header received
0807 10:49:09.761000 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.761008 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.761111 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.761206 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.773123 (+ 11917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.774421 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.836703 (+ 62282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.841598 (+ 4895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.841807 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.888289 (+ 46482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.888299 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.888304 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.888366 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.892603 (+ 4237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.894284 (+ 1681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.894292 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.894296 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.894523 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.895077 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.895083 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.895086 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.895548 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.895854 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.897175 (+ 1321us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.897553 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260807 10:49:09.906534 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:09.739985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49554 (local address 127.11.46.188:43591)
0807 10:49:09.740179 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:09.740186 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:09.769607 (+ 29421us) server_negotiation.cc:407] Connection header received
0807 10:49:09.769977 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:09.769982 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:09.770077 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:09.770154 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:09.816445 (+ 46291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.817700 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.820136 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:09.820853 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:09.820964 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:09.861174 (+ 40210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:09.861184 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:09.861189 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:09.861254 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:09.865185 (+ 3931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.866373 (+ 1188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.866380 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.866385 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.866581 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:09.867153 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:09.867159 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:09.867163 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:09.867575 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:09.867917 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:09.905794 (+ 37877us) server_negotiation.cc:299] Negotiation successful
0807 10:49:09.906147 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 10:49:09.925897 12461 sys_catalog.cc:455] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3b7a721cad4975bff1b61b6fd0cb15" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 33937 } } peers { permanent_uuid: "730a92b6c53a49bdaf430cabc9a42df7" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 42353 } } peers { permanent_uuid: "1ea8179e27dd4745a4914cd28d2ae9c2" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 43591 } } }
I20260807 10:49:09.926252 12461 sys_catalog.cc:458] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:09.954401 12502 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:49:09.956576 12502 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:49:09.968304 12502 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c3b7a721cad4975bff1b61b6fd0cb15: Generated new TSK 0
I20260807 10:49:09.969759 12502 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 10:49:10.082887 11450 mini_kdc.cc:348] Time spent kdestroy: real 0.100s user 0.002s sys 0.039s
W20260807 10:49:10.135298 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.117708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44998 (local address 127.11.46.189:42353)
0807 10:49:10.117973 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.117981 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.132926 (+ 14945us) server_negotiation.cc:407] Connection header received
0807 10:49:10.133312 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.133320 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.133430 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.133549 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.135014 (+ 1465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44998: BlockingRecv error: recv got EOF from 127.0.0.1:44998 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260807 10:49:10.138726 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.123873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49556 (local address 127.11.46.188:43591)
0807 10:49:10.124134 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.124141 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.136162 (+ 12021us) server_negotiation.cc:407] Connection header received
0807 10:49:10.136500 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.136507 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.136607 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.136688 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.138420 (+ 1732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49556: BlockingRecv error: recv got EOF from 127.0.0.1:49556 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260807 10:49:10.139084 12429 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.133157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45760 (local address 127.11.46.190:33937)
0807 10:49:10.133408 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.133414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.136538 (+ 3124us) server_negotiation.cc:407] Connection header received
0807 10:49:10.137343 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.137349 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.137460 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.137546 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.138819 (+ 1273us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45760: BlockingRecv error: recv got EOF from 127.0.0.1:45760 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260807 10:49:10.210985 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.188386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45014 (local address 127.11.46.189:42353)
0807 10:49:10.188655 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.188662 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.208607 (+ 19945us) server_negotiation.cc:407] Connection header received
0807 10:49:10.208942 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.208949 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.209128 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.209275 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.210655 (+ 1380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45014: BlockingRecv error: recv got EOF from 127.0.0.1:45014 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 10:49:10.244443 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.241760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45018 (local address 127.11.46.189:42353)
0807 10:49:10.242050 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.242059 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.242439 (+ 380us) server_negotiation.cc:407] Connection header received
0807 10:49:10.242806 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.242814 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.242937 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.243030 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.244178 (+ 1148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45018: BlockingRecv error: recv got EOF from 127.0.0.1:45018 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260807 10:49:10.271915 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.258583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45032 (local address 127.11.46.189:42353)
0807 10:49:10.258787 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.258793 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.270036 (+ 11243us) server_negotiation.cc:407] Connection header received
0807 10:49:10.270321 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.270327 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.270481 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.270602 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.271629 (+ 1027us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45032: BlockingRecv error: recv got EOF from 127.0.0.1:45032 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260807 10:49:10.286824 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.284021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45042 (local address 127.11.46.189:42353)
0807 10:49:10.284310 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.284317 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.284969 (+ 652us) server_negotiation.cc:407] Connection header received
0807 10:49:10.285232 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.285238 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.285351 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.285540 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.286552 (+ 1012us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45042: BlockingRecv error: recv got EOF from 127.0.0.1:45042 (error 108)
Metrics: {"server-negotiator.queue_time_us":127}
W20260807 10:49:10.302205 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.299190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45046 (local address 127.11.46.189:42353)
0807 10:49:10.299414 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.299420 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.300414 (+ 994us) server_negotiation.cc:407] Connection header received
0807 10:49:10.300650 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.300656 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.300806 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.300931 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.301927 (+ 996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45046: BlockingRecv error: recv got EOF from 127.0.0.1:45046 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 10:49:10.328272 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.324994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45056 (local address 127.11.46.189:42353)
0807 10:49:10.325312 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.325320 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.326330 (+ 1010us) server_negotiation.cc:407] Connection header received
0807 10:49:10.326566 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.326572 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.326698 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.326826 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.327998 (+ 1172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45056: BlockingRecv error: recv got EOF from 127.0.0.1:45056 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
W20260807 10:49:10.370301 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.367796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45068 (local address 127.11.46.189:42353)
0807 10:49:10.368043 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.368051 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.368643 (+ 592us) server_negotiation.cc:407] Connection header received
0807 10:49:10.368843 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.368848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.368988 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.369095 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.370079 (+ 984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45068: BlockingRecv error: recv got EOF from 127.0.0.1:45068 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260807 10:49:10.441015 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.438414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45078 (local address 127.11.46.189:42353)
0807 10:49:10.438635 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.438641 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.439011 (+ 370us) server_negotiation.cc:407] Connection header received
0807 10:49:10.439235 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.439239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.439322 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.439423 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.440680 (+ 1257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45078: BlockingRecv error: recv got EOF from 127.0.0.1:45078 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 10:49:10.562261 12456 catalog_manager.cc:1259] Loaded cluster ID: 3a5a8fecd60c4e59b36d897cd0d0637f
I20260807 10:49:10.562412 12456 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2: loading cluster ID for follower catalog manager: success
I20260807 10:49:10.565186 12456 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2: acquiring CA information for follower catalog manager: success
I20260807 10:49:10.567260 12456 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1ea8179e27dd4745a4914cd28d2ae9c2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 10:49:10.575325 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:10.573056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45082 (local address 127.11.46.189:42353)
0807 10:49:10.573254 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.573259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.573749 (+ 490us) server_negotiation.cc:407] Connection header received
0807 10:49:10.573903 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.573909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.574029 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.574190 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:10.575051 (+ 861us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45082: BlockingRecv error: recv got EOF from 127.0.0.1:45082 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 10:49:10.591627 12476 catalog_manager.cc:1259] Loaded cluster ID: 3a5a8fecd60c4e59b36d897cd0d0637f
I20260807 10:49:10.591738 12476 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7: loading cluster ID for follower catalog manager: success
I20260807 10:49:10.594496 12476 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7: acquiring CA information for follower catalog manager: success
I20260807 10:49:10.596742 12476 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 730a92b6c53a49bdaf430cabc9a42df7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:49:10.840978 12431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:10.835100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45098 (local address 127.11.46.189:42353)
0807 10:49:10.835275 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.835280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.835596 (+ 316us) server_negotiation.cc:407] Connection header received
0807 10:49:10.835772 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.835777 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.835963 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.836085 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:49:10.836481 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:10.837250 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:10.838771 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:10.839219 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:10.839323 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:10.839840 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:49:10.840429 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:49:10.840574 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:10.840619 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 10:49:10.840705 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 10:49:10.854120 12626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:10.847663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49562 (local address 127.11.46.188:43591)
0807 10:49:10.848304 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.848311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.848336 (+ 25us) server_negotiation.cc:407] Connection header received
0807 10:49:10.848471 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.848475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.848660 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.848837 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:49:10.849295 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:10.850136 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:10.851583 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:10.852037 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:10.852160 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:10.852748 (+ 588us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:49:10.853377 (+ 629us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:49:10.853562 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:10.853675 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 10:49:10.853777 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":352,"threads_started":1}
I20260807 10:49:10.873543 12626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:10.862155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49572 (local address 127.11.46.188:43591)
0807 10:49:10.862394 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.862402 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.866571 (+ 4169us) server_negotiation.cc:407] Connection header received
0807 10:49:10.866830 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.866835 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.866940 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.867028 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:49:10.868129 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:10.869265 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:10.871437 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:10.871976 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:10.872130 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:10.872616 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:49:10.872771 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:49:10.872853 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:10.873056 (+ 203us) server_negotiation.cc:299] Negotiation successful
0807 10:49:10.873158 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 10:49:10.875267 12431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:10.861905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45100 (local address 127.11.46.189:42353)
0807 10:49:10.862398 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.862405 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.868368 (+ 5963us) server_negotiation.cc:407] Connection header received
0807 10:49:10.868563 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.868568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.868645 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.868731 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:49:10.869547 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:10.870728 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:10.872950 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:10.873665 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:10.873790 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:10.874391 (+ 601us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:49:10.874533 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:49:10.874602 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:10.874855 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 10:49:10.874958 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323}
I20260807 10:49:10.875631 12634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:10.861922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45774 (local address 127.11.46.190:33937)
0807 10:49:10.867787 (+ 5865us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:10.867794 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:10.867820 (+ 26us) server_negotiation.cc:407] Connection header received
0807 10:49:10.867997 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:10.868003 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:10.868269 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:10.868474 (+ 205us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:49:10.869423 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:10.870262 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:10.872547 (+ 2285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:10.873204 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:10.873331 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:10.874106 (+ 775us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:49:10.874649 (+ 543us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:49:10.874762 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:10.875237 (+ 475us) server_negotiation.cc:299] Negotiation successful
0807 10:49:10.875335 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5710,"thread_start_us":5555,"threads_started":1}
I20260807 10:49:10.885901 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12097
I20260807 10:49:10.887286 12189 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:49:11.002931 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12097
I20260807 10:49:11.039527 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12208
I20260807 10:49:11.040755 12302 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:49:11.165932 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12208
I20260807 10:49:11.212182 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12323
I20260807 10:49:11.213537 12416 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:49:11.329802 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12323
2026-08-07T10:49:11Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5371 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 10:49:11 dist-test-slave-42z9 krb5kdc[12643](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 10:49:11 dist-test-slave-42z9 krb5kdc[12643](info): set up 2 sockets
Aug 07 10:49:11 dist-test-slave-42z9 krb5kdc[12643](info): commencing operation
krb5kdc: starting...
W20260807 10:49:12.617331 11450 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.000s sys 0.073s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/test-user.keytab.
Aug 07 10:49:12 dist-test-slave-42z9 krb5kdc[12643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099752, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T10:49:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T10:49:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.46.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
Entry for principal kudu/127.11.46.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab.
I20260807 10:49:13.036648 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:42023
--webserver_interface=127.11.46.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:42023,127.11.46.189:37051,127.11.46.188:39593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 10:49:13.432639 12668 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:49:13.433048 12668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:49:13.433161 12668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:49:13.433276 12668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:49:13.441224 12668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:49:13.441365 12668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:49:13.441489 12668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:49:13.441565 12668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:49:13.441660 12668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:49:13.452385 12668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:42023,127.11.46.189:37051,127.11.46.188:39593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.190.keytab
--principal=kudu/127.11.46.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.190:42023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.46.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:49:13.453912 12668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:49:13.455415 12668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:49:13.468165 12675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:13.468186 12676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:13.468140 12678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:49:13.469547 12668 server_base.cc:1034] running on GCE node
I20260807 10:49:13.470471 12668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:49:13.472098 12668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:49:13.473356 12668 hybrid_clock.cc:648] HybridClock initialized: now 1786099753473280 us; error 42 us; skew 500 ppm
I20260807 10:49:13.473775 12668 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:49:13 dist-test-slave-42z9 krb5kdc[12643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099753, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:49:13.480895 12668 init.cc:377] Logged in from keytab as kudu/127.11.46.190@KRBTEST.COM (short username kudu)
I20260807 10:49:13.482861 12668 webserver.cc:460] Webserver started at http://127.11.46.190:40361/ using document root <none> and password file <none>
I20260807 10:49:13.483672 12668 fs_manager.cc:359] Metadata directory not provided
I20260807 10:49:13.483781 12668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:49:13.484122 12668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:49:13.487660 12668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/data/instance:
uuid: "cb5a7a63871b4440b9876e32e6316389"
format_stamp: "Formatted at 2026-08-07 10:49:13 on dist-test-slave-42z9"
server_key: "928202aad34f198a4f8fa60a478ef794"
server_key_iv: "0fcc59d430c90df26faeffa460b95e52"
server_key_version: "encryptionkey@0"
I20260807 10:49:13.488562 12668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/wal/instance:
uuid: "cb5a7a63871b4440b9876e32e6316389"
format_stamp: "Formatted at 2026-08-07 10:49:13 on dist-test-slave-42z9"
server_key: "928202aad34f198a4f8fa60a478ef794"
server_key_iv: "0fcc59d430c90df26faeffa460b95e52"
server_key_version: "encryptionkey@0"
I20260807 10:49:13.494746 12668 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 10:49:13.498798 12692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:49:13.500442 12668 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260807 10:49:13.500661 12668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/wal
uuid: "cb5a7a63871b4440b9876e32e6316389"
format_stamp: "Formatted at 2026-08-07 10:49:13 on dist-test-slave-42z9"
server_key: "928202aad34f198a4f8fa60a478ef794"
server_key_iv: "0fcc59d430c90df26faeffa460b95e52"
server_key_version: "encryptionkey@0"
I20260807 10:49:13.500900 12668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:49:13.514726 12668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:49:13.519364 12668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:49:13.519685 12668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:49:13.539597 12668 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.190:42023
I20260807 10:49:13.539620 12766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.190:42023 every 8 connection(s)
I20260807 10:49:13.541102 12668 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/data/info.pb
I20260807 10:49:13.545137 12768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:49:13.550779 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12668
I20260807 10:49:13.550951 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-0/wal/instance
I20260807 10:49:13.551364 11450 external_mini_cluster.cc:1428] Setting key b8a82880f96533a065a58c206da4ddbe
I20260807 10:49:13.552146 12768 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:49:13 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099753, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:49:13.576573 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.555695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42023 (local address 127.0.0.1:38840)
0807 10:49:13.556564 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.556615 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:13.558752 (+ 2137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:13.559617 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:13.559624 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:13.560336 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:13.560703 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:13.560722 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:13.562359 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:13.562363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:13.563498 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:13.563512 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:13.564513 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:13.564521 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:13.564723 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:13.565397 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:13.565422 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:13.568039 (+ 2617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:13.571851 (+ 3812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:13.571866 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:13.571878 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:13.572312 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:13.572755 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:13.572759 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:13.572762 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:13.572927 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:13.573824 (+ 897us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:13.573832 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:13.574056 (+ 224us) client_negotiation.cc:769] Sending connection context
0807 10:49:13.574309 (+ 253us) client_negotiation.cc:240] Negotiation successful
0807 10:49:13.575053 (+ 744us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"mutex_wait_us":188,"thread_start_us":373,"threads_started":1}
I20260807 10:49:13.576603 12773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.557065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38840 (local address 127.11.46.190:42023)
0807 10:49:13.557789 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:13.557797 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:13.557861 (+ 64us) server_negotiation.cc:407] Connection header received
0807 10:49:13.559122 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:13.559128 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:13.559388 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:13.559575 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:13.560930 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:13.562202 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:13.563651 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:13.564237 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:13.564422 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:13.568304 (+ 3882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:13.568314 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:13.568328 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:13.568370 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:13.571693 (+ 3323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:13.572455 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:13.572463 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:13.572465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:13.572636 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:13.573042 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:13.573045 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:13.573047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:13.573675 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:13.573880 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:13.574455 (+ 575us) server_negotiation.cc:299] Negotiation successful
0807 10:49:13.574901 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":522,"thread_start_us":313,"threads_started":1}
I20260807 10:49:13.580639 12768 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:49:13.582254 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.581649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38428)
0807 10:49:13.581887 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.582048 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260807 10:49:13.582662 12699 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
I20260807 10:49:13.584443 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.584016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38442)
0807 10:49:13.584181 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.584260 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:49:13.584682 12768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:37051: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.11.46.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.189@KRBTEST.COM" created.
I20260807 10:49:13.634058 12768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } attempt: 1
I20260807 10:49:13.635447 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.634889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38446)
0807 10:49:13.635143 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.635285 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab.
Entry for principal kudu/127.11.46.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab.
I20260807 10:49:13.636595 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.636193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38458)
0807 10:49:13.636349 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.636429 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 10:49:13.636817 12768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:37051: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
I20260807 10:49:13.637143 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.189:37051
--webserver_interface=127.11.46.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab
--principal=kudu/127.11.46.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:42023,127.11.46.189:37051,127.11.46.188:39593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:49:13.705142 12768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } attempt: 2
I20260807 10:49:13.706666 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.705984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38466)
0807 10:49:13.706325 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.706459 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260807 10:49:13.707998 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.707464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38476)
0807 10:49:13.707662 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.707773 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 10:49:13.708278 12768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:37051: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
I20260807 10:49:13.799613 12768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } attempt: 3
I20260807 10:49:13.801091 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.800479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38486)
0807 10:49:13.800757 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.800902 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260807 10:49:13.802392 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.801895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38488)
0807 10:49:13.802079 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.802182 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 10:49:13.802608 12768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:37051: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
I20260807 10:49:13.945894 12768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } attempt: 4
I20260807 10:49:13.947402 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.946689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38496)
0807 10:49:13.947078 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.947205 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207}
I20260807 10:49:13.948741 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:13.948235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38500)
0807 10:49:13.948406 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:13.948524 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:49:13.949009 12768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.189:37051: Network error: Client connection negotiation failed: client connection to 127.11.46.189:37051: connect: Connection refused (error 111)
W20260807 10:49:14.033807 12777 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:49:14.034198 12777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:49:14.034274 12777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:49:14.034360 12777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:49:14.042359 12777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:49:14.042495 12777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:49:14.042565 12777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:49:14.042620 12777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:49:14.042689 12777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:49:14.053555 12777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:42023,127.11.46.189:37051,127.11.46.188:39593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.189.keytab
--principal=kudu/127.11.46.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.189:37051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.46.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:49:14.055111 12777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:49:14.056588 12777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 10:49:14.069929 12782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:14.070153 12786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:14.069929 12784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:49:14.071316 12777 server_base.cc:1034] running on GCE node
I20260807 10:49:14.072286 12777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:49:14.074110 12777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:49:14.075383 12777 hybrid_clock.cc:648] HybridClock initialized: now 1786099754075287 us; error 65 us; skew 500 ppm
I20260807 10:49:14.075791 12777 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099754, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:49:14.079689 12777 init.cc:377] Logged in from keytab as kudu/127.11.46.189@KRBTEST.COM (short username kudu)
I20260807 10:49:14.081734 12777 webserver.cc:460] Webserver started at http://127.11.46.189:41197/ using document root <none> and password file <none>
I20260807 10:49:14.082648 12777 fs_manager.cc:359] Metadata directory not provided
I20260807 10:49:14.082782 12777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:49:14.083158 12777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:49:14.086956 12777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/data/instance:
uuid: "797973e4c0a04b97a71c5d8b75b55ddf"
format_stamp: "Formatted at 2026-08-07 10:49:14 on dist-test-slave-42z9"
server_key: "e6fcfa19aa7f3c2846526ba583acc84b"
server_key_iv: "d25f409be4b0b2496946707f6b8c6d9f"
server_key_version: "encryptionkey@0"
I20260807 10:49:14.087991 12777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/wal/instance:
uuid: "797973e4c0a04b97a71c5d8b75b55ddf"
format_stamp: "Formatted at 2026-08-07 10:49:14 on dist-test-slave-42z9"
server_key: "e6fcfa19aa7f3c2846526ba583acc84b"
server_key_iv: "d25f409be4b0b2496946707f6b8c6d9f"
server_key_version: "encryptionkey@0"
I20260807 10:49:14.095382 12777 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260807 10:49:14.100383 12798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:49:14.102224 12777 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 10:49:14.102497 12777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/wal
uuid: "797973e4c0a04b97a71c5d8b75b55ddf"
format_stamp: "Formatted at 2026-08-07 10:49:14 on dist-test-slave-42z9"
server_key: "e6fcfa19aa7f3c2846526ba583acc84b"
server_key_iv: "d25f409be4b0b2496946707f6b8c6d9f"
server_key_version: "encryptionkey@0"
I20260807 10:49:14.102787 12777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:49:14.122427 12777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:49:14.127404 12777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:49:14.127730 12777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:49:14.147992 12777 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.189:37051
I20260807 10:49:14.148020 12875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.189:37051 every 8 connection(s)
I20260807 10:49:14.149593 12777 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/data/info.pb
I20260807 10:49:14.150358 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12777
I20260807 10:49:14.150560 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-1/wal/instance
I20260807 10:49:14.151141 11450 external_mini_cluster.cc:1428] Setting key ccd6d033805516026c78418fa986e261
I20260807 10:49:14.154261 12877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:49:14.162484 12877 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099754, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:49:14.186017 12881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.165727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38852 (local address 127.11.46.190:42023)
0807 10:49:14.166306 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.166311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.167594 (+ 1283us) server_negotiation.cc:407] Connection header received
0807 10:49:14.169816 (+ 2222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.169823 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.169935 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.170040 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.171892 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.172730 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.174496 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.174950 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.175072 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.179115 (+ 4043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.179123 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.179126 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.179183 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.182297 (+ 3114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.183254 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.183260 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.183262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.183409 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.183888 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.183893 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.183895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.184270 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.184415 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.185321 (+ 906us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.185611 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":318,"threads_started":1}
I20260807 10:49:14.187099 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.166488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42023 (local address 127.0.0.1:38852)
0807 10:49:14.167383 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.167437 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:14.169430 (+ 1993us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:14.170351 (+ 921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:14.170361 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:14.170985 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:14.171639 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.171660 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.172919 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.172924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.174308 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.174324 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.175229 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.175239 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.175501 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.176253 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:14.176282 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:14.178788 (+ 2506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:14.182516 (+ 3728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.182526 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.182545 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.183093 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.183534 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.183539 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.183542 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.183752 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.184486 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:14.184493 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:14.184899 (+ 406us) client_negotiation.cc:769] Sending connection context
0807 10:49:14.185177 (+ 278us) client_negotiation.cc:240] Negotiation successful
0807 10:49:14.185827 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":376,"threads_started":1}
WARNING: no policy specified for kudu/127.11.46.188@KRBTEST.COM; defaulting to no policy
I20260807 10:49:14.189178 12877 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.46.188@KRBTEST.COM" created.
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099754, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
I20260807 10:49:14.205884 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.190074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38506)
0807 10:49:14.190236 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.190254 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:14.190359 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:14.191317 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:14.191321 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:14.191726 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:14.191874 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.191882 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.193836 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.193841 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.194715 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.194728 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.195887 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.195892 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.196021 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.196637 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:14.196656 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:14.198869 (+ 2213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:14.203018 (+ 4149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.203023 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.203026 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.203469 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.203944 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.203948 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.203950 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.204107 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.204953 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:14.204957 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:14.205093 (+ 136us) client_negotiation.cc:769] Sending connection context
0807 10:49:14.205220 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 10:49:14.205527 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 10:49:14.206446 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.190118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38506 (local address 127.11.46.189:37051)
0807 10:49:14.190789 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.190798 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.190834 (+ 36us) server_negotiation.cc:407] Connection header received
0807 10:49:14.190887 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.190894 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.191127 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.191287 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.192072 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.193687 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.194868 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.195707 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.195836 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.199135 (+ 3299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.199155 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.199178 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.199227 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.202810 (+ 3583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.203631 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.203642 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.203645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.203815 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.204222 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.204226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.204228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.204811 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.205038 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.205411 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.205794 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":341,"threads_started":1}
I20260807 10:49:14.209173 12877 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:49:14.210630 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.210104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49860)
0807 10:49:14.210307 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.210455 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260807 10:49:14.210942 12801 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
I20260807 10:49:14.212674 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.212276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49876)
0807 10:49:14.212447 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.212543 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:49:14.212913 12877 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:39593: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.46.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab.
Entry for principal kudu/127.11.46.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab.
I20260807 10:49:14.237392 11450 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
/tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.188:39593
--webserver_interface=127.11.46.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab
--principal=kudu/127.11.46.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.46.148:35583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.46.190:42023,127.11.46.189:37051,127.11.46.188:39593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 10:49:14.248306 12768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } attempt: 5
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099753, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
I20260807 10:49:14.262270 12877 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } attempt: 1
I20260807 10:49:14.263114 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.249277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38516 (local address 127.11.46.189:37051)
0807 10:49:14.249507 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.249513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.249540 (+ 27us) server_negotiation.cc:407] Connection header received
0807 10:49:14.249684 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.249689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.249791 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.249925 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.250746 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.251701 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.253015 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.253633 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.253767 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.257298 (+ 3531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.257304 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.257307 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.257350 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.260097 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.260917 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.260922 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.260925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.261074 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.261516 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.261522 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.261525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.261858 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.262016 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.262454 (+ 438us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.262769 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 10:49:14.263114 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.249165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38516)
0807 10:49:14.249375 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.249404 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:14.249563 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:14.249938 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:14.249941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:14.250348 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:14.250574 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.250586 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.251898 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.251904 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.252827 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.252843 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.253787 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.253792 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.254002 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.254657 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:14.254678 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:14.257039 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:14.260298 (+ 3259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.260303 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.260306 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.260767 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.261210 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.261215 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.261217 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.261370 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.261991 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:14.261996 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:14.262174 (+ 178us) client_negotiation.cc:769] Sending connection context
0807 10:49:14.262309 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 10:49:14.262710 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 10:49:14.264257 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.262961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49878)
0807 10:49:14.263948 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.264085 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":860}
I20260807 10:49:14.264389 12768 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } has no permanent_uuid. Determining permanent_uuid...
I20260807 10:49:14.265569 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.265105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49886)
0807 10:49:14.265294 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.265403 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 10:49:14.265801 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.265145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49884)
0807 10:49:14.265359 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.265488 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260807 10:49:14.265899 12877 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:39593: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
I20260807 10:49:14.266916 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.266533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49894)
0807 10:49:14.266702 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.266798 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 10:49:14.267158 12768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:39593: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
I20260807 10:49:14.318394 12768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } attempt: 1
I20260807 10:49:14.319707 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.319174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49898)
0807 10:49:14.319399 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.319517 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 10:49:14.320812 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.320466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49902)
0807 10:49:14.320604 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.320687 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 10:49:14.321101 12768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:39593: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
I20260807 10:49:14.334173 12877 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } attempt: 2
I20260807 10:49:14.335532 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.334930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49908)
0807 10:49:14.335193 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.335315 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 10:49:14.336619 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.336224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49918)
0807 10:49:14.336372 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.336464 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 10:49:14.336848 12877 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:39593: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
I20260807 10:49:14.389328 12768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } attempt: 2
I20260807 10:49:14.390791 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.390211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49930)
0807 10:49:14.390462 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.390589 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 10:49:14.391865 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.391526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49938)
0807 10:49:14.391668 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.391746 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 10:49:14.392107 12768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:39593: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
I20260807 10:49:14.428133 12877 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } attempt: 3
I20260807 10:49:14.429617 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.428945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49954)
0807 10:49:14.429215 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.429353 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 10:49:14.431027 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.430414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49960)
0807 10:49:14.430705 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.430822 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165}
W20260807 10:49:14.431319 12877 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:39593: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
I20260807 10:49:14.498319 12768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } attempt: 3
I20260807 10:49:14.499622 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.499103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49964)
0807 10:49:14.499320 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.499434 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260807 10:49:14.500783 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.500374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49968)
0807 10:49:14.500579 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.500666 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260807 10:49:14.501017 12768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:39593: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
I20260807 10:49:14.574622 12877 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } attempt: 4
I20260807 10:49:14.576076 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.575425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49984)
0807 10:49:14.575714 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.575845 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 10:49:14.577316 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.576873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49990)
0807 10:49:14.577051 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.577155 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 10:49:14.577636 12877 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:39593: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
W20260807 10:49:14.646595 12888 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 10:49:14.646984 12888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 10:49:14.647063 12888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 10:49:14.647148 12888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 10:49:14.654906 12888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 10:49:14.655035 12888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 10:49:14.655097 12888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 10:49:14.655150 12888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 10:49:14.655216 12888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 10:49:14.666558 12888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.46.148:35583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.46.190:42023,127.11.46.189:37051,127.11.46.188:39593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/krb5kdc/kudu_127.11.46.188.keytab
--principal=kudu/127.11.46.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.46.188:39593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.46.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 09:12:27 UTC on ccycloud.quasar-rsyjqh.root.comops.site
build id 4572007
ASAN enabled
I20260807 10:49:14.668061 12888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 10:49:14.669531 12888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 10:49:14.678228 12768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } attempt: 4
I20260807 10:49:14.679492 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.679016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:49996)
0807 10:49:14.679213 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.679309 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 10:49:14.680680 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.680274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:50012)
0807 10:49:14.680422 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.680516 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 10:49:14.680976 12768 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.46.188:39593: Network error: Client connection negotiation failed: client connection to 127.11.46.188:39593: connect: Connection refused (error 111)
W20260807 10:49:14.682874 12897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:14.682829 12902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 10:49:14.683073 12899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 10:49:14.684166 12888 server_base.cc:1034] running on GCE node
I20260807 10:49:14.685158 12888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 10:49:14.687042 12888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 10:49:14.688308 12888 hybrid_clock.cc:648] HybridClock initialized: now 1786099754688233 us; error 43 us; skew 500 ppm
I20260807 10:49:14.688699 12888 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099754, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 10:49:14.692152 12888 init.cc:377] Logged in from keytab as kudu/127.11.46.188@KRBTEST.COM (short username kudu)
I20260807 10:49:14.693894 12888 webserver.cc:460] Webserver started at http://127.11.46.188:40433/ using document root <none> and password file <none>
I20260807 10:49:14.694698 12888 fs_manager.cc:359] Metadata directory not provided
I20260807 10:49:14.694821 12888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 10:49:14.695191 12888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 10:49:14.698642 12888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/data/instance:
uuid: "f05908adf95b406e92c65341b7a7815c"
format_stamp: "Formatted at 2026-08-07 10:49:14 on dist-test-slave-42z9"
server_key: "5339c26aaa031f8d01ed4f6dd3a079d9"
server_key_iv: "15e19fc7b9b26b82dc05b120b11e86eb"
server_key_version: "encryptionkey@0"
I20260807 10:49:14.699632 12888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/wal/instance:
uuid: "f05908adf95b406e92c65341b7a7815c"
format_stamp: "Formatted at 2026-08-07 10:49:14 on dist-test-slave-42z9"
server_key: "5339c26aaa031f8d01ed4f6dd3a079d9"
server_key_iv: "15e19fc7b9b26b82dc05b120b11e86eb"
server_key_version: "encryptionkey@0"
I20260807 10:49:14.706086 12888 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 10:49:14.710283 12914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 10:49:14.712047 12888 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 10:49:14.712280 12888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/data,/tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/wal
uuid: "f05908adf95b406e92c65341b7a7815c"
format_stamp: "Formatted at 2026-08-07 10:49:14 on dist-test-slave-42z9"
server_key: "5339c26aaa031f8d01ed4f6dd3a079d9"
server_key_iv: "15e19fc7b9b26b82dc05b120b11e86eb"
server_key_version: "encryptionkey@0"
I20260807 10:49:14.712533 12888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 10:49:14.733098 12888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 10:49:14.737856 12888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 10:49:14.738184 12888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 10:49:14.758671 12888 rpc_server.cc:307] RPC server started. Bound to: 127.11.46.188:39593
I20260807 10:49:14.758708 12985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.46.188:39593 every 8 connection(s)
I20260807 10:49:14.760313 12888 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/data/info.pb
I20260807 10:49:14.763239 11450 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu as pid 12888
I20260807 10:49:14.763446 11450 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktN6EqJ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786099355061134-11450-0/minicluster-data/master-2/wal/instance
I20260807 10:49:14.764011 11450 external_mini_cluster.cc:1428] Setting key 7913e840802935a72bc76547f98a53f3
I20260807 10:49:14.765388 12986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 10:49:14.775611 12986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099752, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099754, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
I20260807 10:49:14.790429 12990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.766010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50018 (local address 127.11.46.188:39593)
0807 10:49:14.766893 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.766910 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.766969 (+ 59us) server_negotiation.cc:407] Connection header received
0807 10:49:14.768709 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.768737 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.769263 (+ 526us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.769797 (+ 534us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.771879 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.773521 (+ 1642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.775459 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.776321 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.776489 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.781650 (+ 5161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.781659 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.781672 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.781725 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.785009 (+ 3284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.785953 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.785962 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.785971 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.786192 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.786678 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.786683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.786685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.787644 (+ 959us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.787994 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.788513 (+ 519us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.788996 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":405,"threads_started":1}
I20260807 10:49:14.797343 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.779133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38856 (local address 127.11.46.190:42023)
0807 10:49:14.780842 (+ 1709us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.780847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.780864 (+ 17us) server_negotiation.cc:407] Connection header received
0807 10:49:14.780923 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.780927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.781014 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.781115 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.782678 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.783485 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.785184 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.785710 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.785857 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.790099 (+ 4242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.790107 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.790112 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.790162 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.793704 (+ 3542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.794809 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.794815 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.794819 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.795066 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.795529 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.795534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.795537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.795895 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.796046 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.796715 (+ 669us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.796916 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1606,"thread_start_us":1456,"threads_started":1}
I20260807 10:49:14.797370 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.779063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.190:42023 (local address 127.0.0.1:38856)
0807 10:49:14.779958 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.780037 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:14.780238 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:14.781268 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:14.781277 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:14.782143 (+ 866us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:14.782476 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.782488 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.783702 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.783706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.784969 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.784988 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.785946 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.785953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.786157 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.786876 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:14.786901 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:14.789824 (+ 2923us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:14.793876 (+ 4052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.793887 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.793892 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.794603 (+ 711us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.795213 (+ 610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.795218 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.795221 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.795403 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.796061 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:14.796072 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:14.796349 (+ 277us) client_negotiation.cc:769] Sending connection context
0807 10:49:14.796610 (+ 261us) client_negotiation.cc:240] Negotiation successful
0807 10:49:14.797035 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":367,"threads_started":1}
I20260807 10:49:14.799135 12986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099752, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.190@KRBTEST.COM
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099754, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
I20260807 10:49:14.812755 12994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.794560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38858 (local address 127.11.46.190:42023)
0807 10:49:14.795288 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.795293 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.795311 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:49:14.795353 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.795357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.795415 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.795512 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.797187 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.798744 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.800369 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.800835 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.800940 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.805962 (+ 5022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.805969 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.805972 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.806018 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.809308 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.810397 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.810404 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.810408 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.810640 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.811020 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.811026 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.811029 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.811443 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.811754 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.812052 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.812311 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":302,"threads_started":1}
I20260807 10:49:14.816382 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.800110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.189:37051 (local address 127.0.0.1:38528)
0807 10:49:14.800339 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.800364 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:14.800498 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:14.801331 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:14.801334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:14.801783 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:14.801952 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.801962 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.803470 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.803474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.804433 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.804449 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.805323 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.805330 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.805581 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.806185 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:14.806207 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:14.808857 (+ 2650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:14.813113 (+ 4256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.813119 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.813123 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.813726 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.814247 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.814253 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.814256 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.814496 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.815294 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:14.815300 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:14.815467 (+ 167us) client_negotiation.cc:769] Sending connection context
0807 10:49:14.815603 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 10:49:14.815967 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 10:49:14.816524 12996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.800046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38528 (local address 127.11.46.189:37051)
0807 10:49:14.800984 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.800990 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.801009 (+ 19us) server_negotiation.cc:407] Connection header received
0807 10:49:14.801069 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.801075 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.801161 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.801279 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.802178 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.803286 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.804613 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.805136 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.805288 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.809129 (+ 3841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.809137 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.809143 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.809194 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.812857 (+ 3663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.813875 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.813880 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.813884 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.814097 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.814656 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.814662 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.814665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.815061 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.815333 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.815754 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.816104 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":820,"thread_start_us":691,"threads_started":1}
I20260807 10:49:14.818286 12986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099752, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.46.189@KRBTEST.COM
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099754, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.188@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
I20260807 10:49:14.832885 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.814830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38538 (local address 127.11.46.189:37051)
0807 10:49:14.815466 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.815470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.815488 (+ 18us) server_negotiation.cc:407] Connection header received
0807 10:49:14.815526 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.815530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.815597 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.815701 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.817402 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.818577 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.820135 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.820596 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.820713 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.826263 (+ 5550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.826270 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.826274 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.826323 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.829833 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.830672 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.830678 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.830681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.830862 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.831272 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.831276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.831278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.831636 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.831902 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.832237 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.832489 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":525,"thread_start_us":322,"threads_started":1}
I20260807 10:49:14.833640 12992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.819169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:50032)
0807 10:49:14.819499 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.819516 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:14.819641 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:14.819939 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:14.819944 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:14.820431 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:14.820589 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.820598 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.821835 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.821841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.823227 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.823246 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.824017 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.824032 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.824269 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.824871 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:14.824898 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:14.827557 (+ 2659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:14.830868 (+ 3311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.830872 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.830875 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.831388 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.831791 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.831796 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.831798 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.831971 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.832607 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:14.832612 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:14.832791 (+ 179us) client_negotiation.cc:769] Sending connection context
0807 10:49:14.832919 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 10:49:14.833256 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246}
I20260807 10:49:14.833930 12990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.819155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50032 (local address 127.11.46.188:39593)
0807 10:49:14.819389 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.819395 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.819590 (+ 195us) server_negotiation.cc:407] Connection header received
0807 10:49:14.819741 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.819745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.819811 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.819889 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.820742 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.821690 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.823397 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.823824 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.823922 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.827789 (+ 3867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.827797 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.827802 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.827847 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.830711 (+ 2864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.831508 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.831514 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.831517 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.831678 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.832098 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.832103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.832107 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.832466 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.832616 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.833057 (+ 441us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.833523 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":125,"server-negotiator.queue_time_us":72}
I20260807 10:49:14.838003 11450 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 10:49:14.839242 12986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c: Bootstrap starting.
I20260807 10:49:14.842964 12986 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c: Neither blocks nor log segments found. Creating new log.
I20260807 10:49:14.840510 12729 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "cb5a7a63871b4440b9876e32e6316389"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38858
I20260807 10:49:14.844197 12986 log.cc:824] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c: Log is configured to *not* fsync() on all Append() calls
I20260807 10:49:14.847566 12986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c: No bootstrap required, opened a new log
I20260807 10:49:14.855343 12986 raft_consensus.cc:348] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } }
I20260807 10:49:14.855762 12986 raft_consensus.cc:729] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f05908adf95b406e92c65341b7a7815c, State: Initialized, Role: FOLLOWER
I20260807 10:49:14.856281 12986 consensus_queue.cc:260] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } }
I20260807 10:49:14.857332 12999 sys_catalog.cc:455] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } } }
I20260807 10:49:14.857802 12999 sys_catalog.cc:458] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:14.858651 12986 sys_catalog.cc:564] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [sys.catalog]: configured and running, proceeding with master startup.
W20260807 10:49:14.869387 13016 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:49:14.869599 13016 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:49:14.866804 12888 master_runner.cc:186] Error getting master registration for 127.11.46.190:42023: OK, instance_id { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" instance_seqno: 1786099753533858 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:49:14.875909 12888 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 10:49:14.876879 12877 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } attempt: 5
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099754, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.189@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
I20260807 10:49:14.892221 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.877647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:50044)
0807 10:49:14.877848 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.877869 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:14.877999 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:14.878432 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:14.878438 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:14.878885 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:14.879069 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.879080 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.880222 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.880228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.881262 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.881279 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.882199 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.882205 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.882469 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.883162 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:14.883182 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:14.885554 (+ 2372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:14.889354 (+ 3800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.889359 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.889364 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.889874 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.890339 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.890345 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.890349 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.890502 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.891158 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:14.891163 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:14.891333 (+ 170us) client_negotiation.cc:769] Sending connection context
0807 10:49:14.891463 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 10:49:14.891809 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 10:49:14.892228 12990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.877889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50044 (local address 127.11.46.188:39593)
0807 10:49:14.878136 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.878142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.878162 (+ 20us) server_negotiation.cc:407] Connection header received
0807 10:49:14.878216 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.878219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.878281 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.878376 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.879246 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.880062 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.881487 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.882017 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.882158 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.885785 (+ 3627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.885791 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.885795 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.885834 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.889154 (+ 3320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.890019 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.890030 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.890041 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.890211 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.890638 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.890643 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.890646 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.891020 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.891199 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.891623 (+ 424us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.891859 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 10:49:14.899278 12877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf: Bootstrap starting.
I20260807 10:49:14.904197 12877 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf: Neither blocks nor log segments found. Creating new log.
I20260807 10:49:14.905798 12877 log.cc:824] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf: Log is configured to *not* fsync() on all Append() calls
I20260807 10:49:14.909852 12877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf: No bootstrap required, opened a new log
I20260807 10:49:14.921887 12877 raft_consensus.cc:348] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } }
I20260807 10:49:14.922415 12877 raft_consensus.cc:729] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 797973e4c0a04b97a71c5d8b75b55ddf, State: Initialized, Role: FOLLOWER
I20260807 10:49:14.923043 12877 consensus_queue.cc:260] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } }
I20260807 10:49:14.924649 13019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } } }
I20260807 10:49:14.925197 13019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:14.926352 12877 sys_catalog.cc:564] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [sys.catalog]: configured and running, proceeding with master startup.
W20260807 10:49:14.938014 13038 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 10:49:14.938257 13038 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 10:49:14.934736 12777 master_runner.cc:186] Error getting master registration for 127.11.46.190:42023: OK, instance_id { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" instance_seqno: 1786099753533858 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 10:49:14.943885 12777 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 10:49:14.958240 12768 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } attempt: 5
Aug 07 10:49:14 dist-test-slave-42z9 krb5kdc[12643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786099753, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.46.190@KRBTEST.COM for kudu/127.11.46.188@KRBTEST.COM
I20260807 10:49:14.975975 12990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.959136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50058 (local address 127.11.46.188:39593)
0807 10:49:14.959406 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:14.959412 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:14.959522 (+ 110us) server_negotiation.cc:407] Connection header received
0807 10:49:14.959764 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:14.959771 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:14.959860 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:14.959950 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:14.960835 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.962094 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.963425 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.964218 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.964362 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.968809 (+ 4447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:14.968815 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:14.968819 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:14.968859 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:14.972737 (+ 3878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.973587 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.973595 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.973599 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.973801 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:14.974283 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:14.974290 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:14.974294 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:14.974740 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:14.974906 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:14.975351 (+ 445us) server_negotiation.cc:299] Negotiation successful
0807 10:49:14.975631 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 10:49:14.975978 12771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:14.959063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.46.188:39593 (local address 127.0.0.1:50058)
0807 10:49:14.959416 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0807 10:49:14.959453 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 10:49:14.959607 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 10:49:14.960013 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 10:49:14.960017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 10:49:14.960461 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0807 10:49:14.960641 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.960652 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.962252 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.962258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.963252 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 10:49:14.963268 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 10:49:14.964406 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 10:49:14.964414 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 10:49:14.964610 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:14.965307 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 10:49:14.965335 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 10:49:14.968519 (+ 3184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 10:49:14.972951 (+ 4432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.972958 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.972963 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.973412 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.973941 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 10:49:14.973946 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 10:49:14.973950 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 10:49:14.974143 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 10:49:14.974875 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 10:49:14.974881 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 10:49:14.975076 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 10:49:14.975213 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 10:49:14.975562 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216}
I20260807 10:49:14.981433 12768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389: Bootstrap starting.
I20260807 10:49:14.986282 12768 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389: Neither blocks nor log segments found. Creating new log.
I20260807 10:49:14.987881 12768 log.cc:824] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389: Log is configured to *not* fsync() on all Append() calls
W20260807 10:49:14.990650 12923 tablet.cc:2369] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:49:14.992223 12768 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389: No bootstrap required, opened a new log
I20260807 10:49:15.000922 12768 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } }
I20260807 10:49:15.001454 12768 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb5a7a63871b4440b9876e32e6316389, State: Initialized, Role: FOLLOWER
I20260807 10:49:15.002141 12768 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } }
I20260807 10:49:15.003573 13043 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } } }
I20260807 10:49:15.004366 13043 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:15.005281 12768 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 10:49:15.005342 12729 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 10:49:15.005791 12729 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:49:15.008517 12729 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } }
I20260807 10:49:15.010169 12729 leader_election.cc:288] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [CANDIDATE]: Term 1 election: Requested vote from peers 797973e4c0a04b97a71c5d8b75b55ddf (127.11.46.189:37051), f05908adf95b406e92c65341b7a7815c (127.11.46.188:39593)
I20260807 10:49:15.011214 12837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb5a7a63871b4440b9876e32e6316389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "797973e4c0a04b97a71c5d8b75b55ddf"
I20260807 10:49:15.011890 12837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:49:15.016301 12949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cb5a7a63871b4440b9876e32e6316389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f05908adf95b406e92c65341b7a7815c"
I20260807 10:49:15.016990 12949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [term 0 FOLLOWER]: Advancing to term 1
I20260807 10:49:15.017117 12837 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb5a7a63871b4440b9876e32e6316389 in term 1.
I20260807 10:49:15.018040 12699 leader_election.cc:302] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 797973e4c0a04b97a71c5d8b75b55ddf, cb5a7a63871b4440b9876e32e6316389; no voters:
I20260807 10:49:15.018699 13043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 10:49:15.021016 12949 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb5a7a63871b4440b9876e32e6316389 in term 1.
I20260807 10:49:15.022888 13043 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [term 1 LEADER]: Becoming Leader. State: Replica: cb5a7a63871b4440b9876e32e6316389, State: Running, Role: LEADER
W20260807 10:49:15.023325 12701 tablet.cc:2369] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:49:15.023761 13043 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } }
I20260807 10:49:15.039039 13048 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb5a7a63871b4440b9876e32e6316389. Latest consensus state: current_term: 1 leader_uuid: "cb5a7a63871b4440b9876e32e6316389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } } }
I20260807 10:49:15.039664 13048 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:15.049394 13053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 10:49:15.088850 13053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 10:49:15.103709 13076 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260807 10:49:15.130877 12804 tablet.cc:2369] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 10:49:15.132947 12837 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [term 1 FOLLOWER]: Refusing update from remote peer cb5a7a63871b4440b9876e32e6316389: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:49:15.134547 13043 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:49:15.136694 12949 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [term 1 FOLLOWER]: Refusing update from remote peer cb5a7a63871b4440b9876e32e6316389: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 10:49:15.138088 13043 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 10:49:15.163620 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:15.056024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38552 (local address 127.11.46.189:37051)
0807 10:49:15.056401 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.056407 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.059242 (+ 2835us) server_negotiation.cc:407] Connection header received
0807 10:49:15.060254 (+ 1012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.060261 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.060358 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.060441 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.064919 (+ 4478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:15.066273 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:15.069687 (+ 3414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:15.070552 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:15.070691 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:15.106978 (+ 36287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:15.106987 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:15.106993 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:15.107065 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:15.125350 (+ 18285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:15.127234 (+ 1884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:15.127242 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:15.127246 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:15.127572 (+ 326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:15.128157 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:15.128164 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:15.128167 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:15.128640 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:15.128967 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:15.162821 (+ 33854us) server_negotiation.cc:299] Negotiation successful
0807 10:49:15.163197 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187}
I20260807 10:49:15.186035 12999 sys_catalog.cc:455] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb5a7a63871b4440b9876e32e6316389. Latest consensus state: current_term: 1 leader_uuid: "cb5a7a63871b4440b9876e32e6316389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } } }
I20260807 10:49:15.186430 12999 sys_catalog.cc:458] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:15.189512 12994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:15.052795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38860 (local address 127.11.46.190:42023)
0807 10:49:15.053010 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.053016 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.055267 (+ 2251us) server_negotiation.cc:407] Connection header received
0807 10:49:15.055899 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.055906 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.056001 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.056086 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.073598 (+ 17512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:15.074872 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:15.094259 (+ 19387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:15.095098 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:15.095242 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:15.176098 (+ 80856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:15.176106 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:15.176111 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:15.176166 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:15.180694 (+ 4528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:15.181998 (+ 1304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:15.182007 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:15.182011 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:15.182248 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:15.185492 (+ 3244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:15.185500 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:15.185504 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:15.186014 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:15.186315 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:15.188739 (+ 2424us) server_negotiation.cc:299] Negotiation successful
0807 10:49:15.189087 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 10:49:15.193606 12990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:15.053843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50064 (local address 127.11.46.188:39593)
0807 10:49:15.054132 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.054138 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.058101 (+ 3963us) server_negotiation.cc:407] Connection header received
0807 10:49:15.059319 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.059326 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.059509 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.059603 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.089354 (+ 29751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:15.090664 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:15.104256 (+ 13592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:15.105106 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:15.105230 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:15.170554 (+ 65324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 10:49:15.170565 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 10:49:15.170571 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 10:49:15.170629 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 10:49:15.174834 (+ 4205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:15.182885 (+ 8051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:15.182894 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:15.182898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:15.183143 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 10:49:15.186823 (+ 3680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 10:49:15.186832 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 10:49:15.186836 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 10:49:15.187298 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 10:49:15.187639 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:15.192736 (+ 5097us) server_negotiation.cc:299] Negotiation successful
0807 10:49:15.193089 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:49:15.196096 13077 mvcc.cc:205] Tried to move back new op lower bound from 7315864597006970880 to 7315864596587679744. Current Snapshot: MvccSnapshot[applied={T|T < 7315864597006970880}]
I20260807 10:49:15.198460 13082 mvcc.cc:205] Tried to move back new op lower bound from 7315864597006970880 to 7315864596587679744. Current Snapshot: MvccSnapshot[applied={T|T < 7315864597006970880}]
I20260807 10:49:15.210104 13048 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb5a7a63871b4440b9876e32e6316389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } } }
I20260807 10:49:15.210500 13048 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:15.211661 13019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb5a7a63871b4440b9876e32e6316389. Latest consensus state: current_term: 1 leader_uuid: "cb5a7a63871b4440b9876e32e6316389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } } }
I20260807 10:49:15.212059 13019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:15.214231 12999 sys_catalog.cc:455] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb5a7a63871b4440b9876e32e6316389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } } }
I20260807 10:49:15.214587 12999 sys_catalog.cc:458] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:15.216280 13053 catalog_manager.cc:1347] Generated new cluster ID: 040e2dbd59f44484ba336f3db3a60efb
I20260807 10:49:15.216408 13053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 10:49:15.224063 13048 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cb5a7a63871b4440b9876e32e6316389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } } }
I20260807 10:49:15.224385 13048 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389 [sys.catalog]: This master's current role is: LEADER
I20260807 10:49:15.239502 13019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cb5a7a63871b4440b9876e32e6316389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5a7a63871b4440b9876e32e6316389" member_type: VOTER last_known_addr { host: "127.11.46.190" port: 42023 } } peers { permanent_uuid: "797973e4c0a04b97a71c5d8b75b55ddf" member_type: VOTER last_known_addr { host: "127.11.46.189" port: 37051 } } peers { permanent_uuid: "f05908adf95b406e92c65341b7a7815c" member_type: VOTER last_known_addr { host: "127.11.46.188" port: 39593 } } }
I20260807 10:49:15.239874 13019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf [sys.catalog]: This master's current role is: FOLLOWER
I20260807 10:49:15.292528 13053 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 10:49:15.294759 13053 catalog_manager.cc:1504] Loading token signing keys...
I20260807 10:49:15.338512 13053 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb5a7a63871b4440b9876e32e6316389: Generated new TSK 0
I20260807 10:49:15.339907 13053 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 10:49:15.458979 11450 mini_kdc.cc:348] Time spent kdestroy: real 0.102s user 0.000s sys 0.041s
W20260807 10:49:15.509550 12994 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.492960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38872 (local address 127.11.46.190:42023)
0807 10:49:15.493206 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.493213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.498211 (+ 4998us) server_negotiation.cc:407] Connection header received
0807 10:49:15.507488 (+ 9277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.507495 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.507622 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.507708 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.509220 (+ 1512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38872: BlockingRecv error: recv got EOF from 127.0.0.1:38872 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260807 10:49:15.511168 12990 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.498725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50068 (local address 127.11.46.188:39593)
0807 10:49:15.498934 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.498941 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.505855 (+ 6914us) server_negotiation.cc:407] Connection header received
0807 10:49:15.506252 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.506260 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.506372 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.506459 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.510914 (+ 4455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50068: BlockingRecv error: recv got EOF from 127.0.0.1:50068 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260807 10:49:15.512215 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.502463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38566 (local address 127.11.46.189:37051)
0807 10:49:15.502680 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.502687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.510108 (+ 7421us) server_negotiation.cc:407] Connection header received
0807 10:49:15.510571 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.510579 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.510702 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.510777 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.511936 (+ 1159us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38566: BlockingRecv error: recv got EOF from 127.0.0.1:38566 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 10:49:15.524027 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.520323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38578 (local address 127.11.46.189:37051)
0807 10:49:15.520531 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.520538 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.522041 (+ 1503us) server_negotiation.cc:407] Connection header received
0807 10:49:15.522430 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.522441 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.522668 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.522813 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.523772 (+ 959us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38578: BlockingRecv error: recv got EOF from 127.0.0.1:38578 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 10:49:15.551656 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.542296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38594 (local address 127.11.46.189:37051)
0807 10:49:15.542583 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.542591 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.550198 (+ 7607us) server_negotiation.cc:407] Connection header received
0807 10:49:15.550423 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.550428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.550513 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.550601 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.551434 (+ 833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38594: BlockingRecv error: recv got EOF from 127.0.0.1:38594 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 10:49:15.567721 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.561832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38596 (local address 127.11.46.189:37051)
0807 10:49:15.562085 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.562093 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.566172 (+ 4079us) server_negotiation.cc:407] Connection header received
0807 10:49:15.566382 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.566387 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.566472 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.566562 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.567458 (+ 896us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38596: BlockingRecv error: recv got EOF from 127.0.0.1:38596 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260807 10:49:15.577623 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.575479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38602 (local address 127.11.46.189:37051)
0807 10:49:15.575749 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.575755 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.575991 (+ 236us) server_negotiation.cc:407] Connection header received
0807 10:49:15.576200 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.576207 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.576315 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.576463 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.577253 (+ 790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38602: BlockingRecv error: recv got EOF from 127.0.0.1:38602 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
W20260807 10:49:15.591711 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.589551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38612 (local address 127.11.46.189:37051)
0807 10:49:15.589802 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.589809 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.590126 (+ 317us) server_negotiation.cc:407] Connection header received
0807 10:49:15.590325 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.590331 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.590460 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.590606 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.591462 (+ 856us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38612: BlockingRecv error: recv got EOF from 127.0.0.1:38612 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
W20260807 10:49:15.613726 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.611593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38614 (local address 127.11.46.189:37051)
0807 10:49:15.611822 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.611829 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.612151 (+ 322us) server_negotiation.cc:407] Connection header received
0807 10:49:15.612326 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.612332 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.612451 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.612579 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.613363 (+ 784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38614: BlockingRecv error: recv got EOF from 127.0.0.1:38614 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260807 10:49:15.652045 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.649700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38630 (local address 127.11.46.189:37051)
0807 10:49:15.649959 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.649966 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.650387 (+ 421us) server_negotiation.cc:407] Connection header received
0807 10:49:15.650644 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.650649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.650731 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.650828 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.651774 (+ 946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38630: BlockingRecv error: recv got EOF from 127.0.0.1:38630 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260807 10:49:15.722880 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.720745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38642 (local address 127.11.46.189:37051)
0807 10:49:15.721051 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.721058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.721303 (+ 245us) server_negotiation.cc:407] Connection header received
0807 10:49:15.721538 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.721544 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.721648 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.721746 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.722650 (+ 904us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38642: BlockingRecv error: recv got EOF from 127.0.0.1:38642 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
W20260807 10:49:15.856904 12997 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 10:49:15.854965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38646 (local address 127.11.46.189:37051)
0807 10:49:15.855238 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:15.855245 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:15.855464 (+ 219us) server_negotiation.cc:407] Connection header received
0807 10:49:15.855691 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:15.855696 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:15.855776 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:15.855871 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 10:49:15.856701 (+ 830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38646: BlockingRecv error: recv got EOF from 127.0.0.1:38646 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 10:49:15.871826 13016 catalog_manager.cc:1259] Loaded cluster ID: 040e2dbd59f44484ba336f3db3a60efb
I20260807 10:49:15.871943 13016 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c: loading cluster ID for follower catalog manager: success
I20260807 10:49:15.874747 13016 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c: acquiring CA information for follower catalog manager: success
I20260807 10:49:15.876756 13016 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f05908adf95b406e92c65341b7a7815c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:49:15.941025 13038 catalog_manager.cc:1259] Loaded cluster ID: 040e2dbd59f44484ba336f3db3a60efb
I20260807 10:49:15.941164 13038 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf: loading cluster ID for follower catalog manager: success
I20260807 10:49:15.944128 13038 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf: acquiring CA information for follower catalog manager: success
I20260807 10:49:15.946501 13038 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 797973e4c0a04b97a71c5d8b75b55ddf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 10:49:16.122944 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:16.116881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38654 (local address 127.11.46.189:37051)
0807 10:49:16.117131 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:16.117138 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:16.117323 (+ 185us) server_negotiation.cc:407] Connection header received
0807 10:49:16.117608 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:16.117613 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:16.117808 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:16.117925 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:49:16.118372 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:16.119109 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:16.120486 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:16.120923 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:16.121037 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:16.121638 (+ 601us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:49:16.122269 (+ 631us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:49:16.122423 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:16.122540 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 10:49:16.122637 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:49:16.136274 13182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:16.129534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50070 (local address 127.11.46.188:39593)
0807 10:49:16.130128 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:16.130136 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:16.130201 (+ 65us) server_negotiation.cc:407] Connection header received
0807 10:49:16.130479 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:16.130484 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:16.130657 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:16.130831 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:49:16.131305 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:16.132250 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:16.133814 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:16.134239 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:16.134365 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:16.134944 (+ 579us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:49:16.135550 (+ 606us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:49:16.135705 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:16.135817 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 10:49:16.135919 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":356,"threads_started":1}
I20260807 10:49:16.152448 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:16.143148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38662 (local address 127.11.46.189:37051)
0807 10:49:16.143377 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:16.143383 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:16.144596 (+ 1213us) server_negotiation.cc:407] Connection header received
0807 10:49:16.144715 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:16.144721 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:16.144810 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:16.144894 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:49:16.146200 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:16.146980 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:16.149800 (+ 2820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:16.150599 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:16.150690 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:16.151529 (+ 839us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:49:16.151697 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:49:16.151765 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:16.151991 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 10:49:16.152088 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 10:49:16.153046 13182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:16.142998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50080 (local address 127.11.46.188:39593)
0807 10:49:16.143570 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:16.143576 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:16.144506 (+ 930us) server_negotiation.cc:407] Connection header received
0807 10:49:16.144594 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:16.144598 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:16.144694 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:16.144787 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:49:16.145424 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:16.147006 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:16.149810 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:16.150508 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:16.150662 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:16.151529 (+ 867us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:49:16.151696 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:49:16.151781 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:16.152476 (+ 695us) server_negotiation.cc:299] Negotiation successful
0807 10:49:16.152575 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432}
I20260807 10:49:16.153156 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 10:49:16.142826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38888 (local address 127.11.46.190:42023)
0807 10:49:16.143370 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0807 10:49:16.143377 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 10:49:16.144361 (+ 984us) server_negotiation.cc:407] Connection header received
0807 10:49:16.144518 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 10:49:16.144524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 10:49:16.144770 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 10:49:16.144983 (+ 213us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 10:49:16.146295 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:16.147357 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:16.149931 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 10:49:16.150635 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 10:49:16.150764 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 10:49:16.151669 (+ 905us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 10:49:16.152126 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 10:49:16.152232 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 10:49:16.152729 (+ 497us) server_negotiation.cc:299] Negotiation successful
0807 10:49:16.152829 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":298,"threads_started":1}
I20260807 10:49:16.159409 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12668
I20260807 10:49:16.160984 12758 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:49:16.275583 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12668
I20260807 10:49:16.308993 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12777
I20260807 10:49:16.310238 12869 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:49:16.428843 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12777
I20260807 10:49:16.465335 11450 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu pid 12888
I20260807 10:49:16.466542 12981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 10:49:16.580497 11450 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktN6EqJ/build/asan/bin/kudu with pid 12888
2026-08-07T10:49:16Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5247 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10619 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (401490 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST